BDSTTle'W  AD  AO  59  8 42 


78  10  03  030 


AD  AO  59  842 


(9 


£.-3  ^ILOT  ERRORS 
K.  tMDNC&PTUAL  ^APPROACH  * 

By  

/ ] DJ  THOMAS  V. I GOLDER 
VL^/g PT  ^ ^ USN  1 


( 


June  1978 


_y 


H'e.  pj 


p 1 '3 


mx 


The  views  contained  herein  are  those  of  the  author,  and 
publication  of  this  research  by  the  Center  for  Advanced 
Research,  Naval  War  College,  does  not  constitute  en- 
dorsement thereof  by  the  Naval  War  College,  the  Depart- 
ment of  the  Navy,  or  any  other  branch  of  the  U.S. 
Government . 


Further  reproduction  of  this  paper  by  agencies  of  the 
U.S.  Government  must  be  approved  by  the  President,  Naval 
War  College.  Reproduction  by  nongovernment  agencies  or 
individuals  without  the  written  consent  of  the  President, 
Naval  War  College,  is  prohibited.  The  content,  however, 
is  open  to  citation  and  other  reference  in  accordance 
with  accepted  research  practices. 


DIET?’  • ''K  -':7' 

Ap; 

l . 


X ft  /j  ^ / 


EXECUTIVE  SUMMARY 


Chapter  I - Introduction.  The  basic  thrust  of  this 
study  is  to  improve  our  understanding  of  pilot  errors  by 
examining  pilots'  attitudes  toward,  and  perceptions  of, 
erior..  in  a way  never  attempted  before.  Background  informa- 
tion on  a recent  study  of  the  game  of  "Eight  Ball"  is  pro- 
vided in  this  chapter  since  the  "Eight  Ball"  study  was 
used  as  a guide  in  the  examination  of  pilot  errors.  Com- 
puter programs  for  cluster  analysis,  multidimensional 
scaling  and  discriminant  analysis  were  utilized  in  this 
exploratory  research  project. 


Chapter  II  - Method.  This  chapter  describes  the  method- 
ology used  to  examine  pilot  behaviors  as  pretested  on  23 
Newport  area  P-3  pilots.  Sixty  P-3  pilot  behaviors  were 
typed  on  3x5  cards, and  each  of  the  pilots  was  asked  to 
sort  the  cards  into  two  or  more  piles  as  they  perceived 
the  behaviors  related  to  one  another.  The  respondents' 
sortings  were  subjected  to  cluster  analysis, and  the  solu- 
tion resulted  in  three  major  clusters  that  seemed  to  fit 
logically  within  the  realm  of  P-3  piloting.  The  clusters 
are  briefly  described  and  depicted  in  three  dimensional 
representations.  Since  there  was  a patterning  of  P-3 
pilot  behaviors,  it  was  thought  that  there  would  be  pattern- 
ing among  P-3  pilot  errors. 
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Cnapter  III  - The  First  Fleet  Pilot  Study.  This 
chapter  describes  the  first  round  of  interviews  that  were 
conducted  with  51  P-3  pilots  stationed  at  a major  P-3 
patrol  squadron  base.  These  pilots  were  asked  to  sort 
60  cards,  on  which  were  typed  P-3  pilot  errors,  into  more 
than  two  piles,  as  they  perceived  the  errors  went  together. 
These  pilots  were  also  asked  to  sort  the  same  60  errors 
into  seven  slots  in  a box  ranging  from  "most  serious"  to 
"least  serious".  Seriousness  is  discussed  in  Chapter  VI. 
The  clustering  solutions  of  "Acceptable,"  "t’r.accaptable" , 
and  "Runway  Environment  Technique"  errors  were  depicted 
and  discussed.  Multidimensional  scaling  solutions  were 
depicted  to  shov;  the  dimensions  of  the  clusters  as  named 
by  the  author.  These  dimensions  give  us  clues  as  to  how 
pilots  view  the  errors  thus  leading  us  to  a better  under- 
standing of  pilots'  perceptions. 

Chapter  IV  - The  Second  Fleet  Pilot  Study.  This 
chapter  follows  the  same  format  as  the  preceding  chapter 
in  describing  the  second  study  of  52  P-3  pilots  accomplished 
at  another  major  patrol  squadron  base.  These  pilots  were 
interviewed  in  the  same  manner  as  the  first  group  except 
that  they  were  a] so  asked  to  rank  order  13  preselected 
errors  on  four  attributes:  Career,  Rattle,  Embarrassment 
and  Fun.  Results  of  these  rankings  are  discussed  in 
Chapter  VII.  The  clustering  solution  for  the  second 
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group  of  pilots,  although  much  the  same  as  the  first  group  s 
cluster  solution,  has  some  differences  that  are  discussed 
along  with  possible  reasons  for  the  differences.  Also,  as  in 
the  preceding  chapter,  multidimensional  scaling  solutions 
for  each  cluster  are  provided. 

Chapter  V - The  Combined  Results.  The  data  for  all 
103  pilots  were  aggregated  and  subjected  to  cluster  analysis 
and  multidimensional  scaling.  Results  are  treated  in  this 
chapter  in  the  same  format  as  the  two  preceding  chapters. 

The  concept  that  the  respondents  have  views  of  a "pilot" 
that  differ  from  views  of  an  "aviator"  is  discussed  as  a 
possible,  p^afon^for.  the  qlystering  of  Acceptable  Errors 
and  Runway  Environment  Technique  Errors.  As  in  the  pre- 
ceding chapters,  multidimensional  scaling  solutions  are 
provided . 

Chapter  VI  - Seriousness.  This  chapter  treats  the  re- 
sults of  the  seriousness  scaling.  The  pilots  were  divided 
into  groups  of  low  (40-799  hrs) , medium  (800-1499  hrs)  and 
high  (over  1500  hrs)  P-3  flight  hours.  Using  this  grouping 
and  grouping  by  base  location,  a discriminant  analysis  program 
could  predict  group  membership  fairly  accurately,  based  on 
how  the  respondent  sorted  the  errors.  The  idea  that  some 
pilots  in  the  "high"  group  sort  errors  in  the  same  manner  as 
the  pilots  in  the  "low"  group  (or  vice  versa)  is  discussed 
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along  with  possible  implications  and  applications  for  the 
future.  Tables  are  presented  for  the  discriminant  analysis 
findings  and  the  seriousness  ranking. 

Chapter  VII  - Attributes.  This  chapter  contains  a 
brief  discussion  of  the  results  of  the  ranking  of  the  13 
preselected  errors  along  the  four  attributes  of  Career, 
Rattle,  Embarrassment  and  Fun.  A table  depicts  the  mean 
rankings,  and  discussion  centers  on  the  finding  that  some 
errors  are  perceived  as  career  wreckers,  embarrassing, 
likely  to  rattle  and  not  much  fun,  but  these  are  errors 
that  are  not  likely  to  cause  much  damage  or  bring  about 
loss  of  life!  6n  the  other' hAnG;  there  are  seme -errors  . 
that  are  perceived  to  have  an  element  of  fun  that  are  high 
risk  errors, and  the  possibility  for  loss  of  life  and  air- 
craft damage  is  high  when  these  errors  occur. 

Chapter  VIII  - Conclusion,  New  Directions.  This  chapte 
summarizes  what  has  been  learned  from  the  study.  The  points 
covered  are  thac: 

a.  It  is  possible  to  use  clustering  techniques 

to  make  explicit  certain  implicit  patterning  of  pilot  errors 

b.  Multidimensional  scaling  can  identify  sig- 
nificant dimensions  of  the  error  space  and  these  dimensions 
may  give  us  directions  for  the  future  study  of  errors. 
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c.  There  are  differences  in  the  way  pilots  view 
the  seriousness  of  errors  and  these  differences  might  suggest 
areas  for  further  study. 

d.  A .subset  of  errors,  more  manageable  in  size, 

might  model  the  total  error  space. 

e.  Scaling  of  errors  on  certain  attributes  might 
give  us  clues  as  to  what  changes  in  pilots'  attitudes  to 
strive  for  to  achieve  a safer  flying  environment. 
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INTRODUCTION 

Man's  mi scalculations--of  inches  or  feet, 
seconds  or  minutes,  thickness,  width,  solidity 
and  a dozen  other  f actors— have  induced  great 
suffering  throughout  history.! 

Human  error  continues  to  plague  the  aviation  community 

at  a time  when  great  strides  are  being  made  in  designing 

safety  features  into  aircraft.  Aviation  accident  rates  have 

tumbled  in  the  last  two  decades,  yet  the  percentage  of  acci- 
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dents  attributed  to  human  error  has  remained  fairly  stable. 
Human  error  research  must  therefore  go  on,  and  improved 
understanding  is  required  if  there  is  to  be  a drastic  reduc- 
tion in  pilot  error  accidents.  We  must  find  the  "why"  of 
human  error. 

Background — The  Roberts/Chick  Study 

In  1977  John  M.  Roberts  and  Gary  E.  Chick  conducted  a 
study  of  a league  of  "Eight  Ball"  players  in  Western 
Pennsylvania . ^ This  exploratory  study  was  an  attempt  to 
construct  a model  of  the  behavioral  array  of  actions  asso- 
ciated with  the  play  of  the  pool-type  game  of  "Eight  Ball." 
In  this  study  an  informed  judge  listed  sixty  "Eight  Ball" 
behaviors,  good  and  bad,  important  and  unimportant,  inter- 
esting and  uninteresting,  which  he  felt  represented  the  full 
behavioral  array  found  in  "Eight  Ball."  Examples  of  these 
behaviors  are:  CHALKING  THE  CUE  STICK,  RACKING  THE  BALLS 
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and  CALLING  THE  POCKET.  The  selection  of  behaviors  was  only 
an  ethnographic  judgment,  but  the  judge  was  a long-term 
player  who  was  completely  familiar  with  the  game  and  the 
league.  The  sixty  behaviors  he  identified  constituted,  then, 
a model  of  "Eight  Ball"  behavioral  space.  Expressions 
commonly  used  for  the  sixty  behaviors  by  most  "Eight  Ball" 
players  were  entered  on  3 by  5 cards.  Forty-five  experienced 
members  of  the  league  were  given  the  cards,  and  each  player 
sorted  them  into  piles,  based  on  the  similarities  which  he 
determined  the  various  behaviors  had  to  each  other.  An 
aggregate  similarity  matrix  based  on  sorting  was  then 
clustered. 

Clustering  refers  to  a number  of  related  statistical 
classification  techniques  that  take  data  units  (in  this  case 
"Eight  Ball"  behaviors)  and  ideally  group  them  into  clusters 
so  that  elements  within  a cluster  have  a high  degree  of 
natural  association  among  themselves,  while  the  clusters 
are  relatively  distinct  from  one  another.  The  extent  to 
which  a procedure  results  in  such  clusters  depends  upon  the 
structuring  inherent  in  the  data  based  upon  an  aggregation 
of  the  clusters  of  each  participant.  Hierarchical  clustering 
techniques  produce  representations  of  the  data  units  that 
are  roughly  analogous  to  the  taxonomies  of  descriptive 
semantics . 

Each  of  the  main  clusters  was  treated  as  a domain,  and 
the  behaviors  within  the  domain  were  subjected  in  turn  to 
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multidimensional  scalinq.  Roberts  and  Chick  determined 
that  both  the  clusters  and  dimensions  produced  by  these 
procedures  have  ethnographic  import.  Stated  somewhat  dif- 
ferently, the  clusters  and  dimensions  must  be  understood  if 
people  are  to  understand  the  play  of  the  game  as  it  actually 
occurs . 

Finally,  the  attitudinal  study  of  a small  sample  of 
experts  and  a small  sample  of  more  ordinary  players  was  con- 
ducted. All  of  the  players  scaled  all  of  the  behaviors 
associated  with  actual  play  in  terms  of  the  fun  they  experi- 
enced when  they  performed  them.  Players  also  scaled  their 
estimates  of  the  amount  of  concentration  that  a set  of 
behaviors  required  and  the  degree  to  which  their  concentra- 
tion was  broken  when  they  practiced  certain  behaviors. 

The  total  analysis  therefore,  dealt  with  a sample  of 

actual  behaviors  occurring  in  the  space  on  and  around  the 

pooltable  in  the  course  of  the  play  of  "Eight  Ball"  and  the 

conceptual  space  into  which  the  players  place  this  play. 

Then,  to  a degree,  attitudes  towards  concentration  and  fun 
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were  "mapped"  within  the  described  space.  The  total  descrip- 
tion gained  from  such  mapping  leads  to  a better  understanding 
of  the  play  of  the  game,  and  the  authors  believe  that  it  will 
also  give  clues  as  to  the  factors  that  determine  why  some 
players  are  better  than  others. 

Research  Objectives 

Until  technology  produces  an  automated  flying  machine 
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with  no  pilot  aboard,  we  must  continually  strive  to  reduce 
human  errors  in  aviation.  The  Navy  invests  heavily  in 
training  and  safety  programs  in  order  to  produce  a competent, 
safe  pilot.  Following  the  lead  of  the  Roberts/Chick  study, 
it  seems  reasonable  that  an  understanding  of  pilots'  atti- 
tudes toward  errors  might  furnish  insights  and  suggest  new 
dimensions  for  effort  in  the  field  of  training  and  safety. 

This  study  is,  therefore,  an  exploratory  attempt  to  discover 
more  about  pilot  errors  and  to  search  for  a new  way  to  view 
the  space  of  errors  for  the  purpose  of  achieving  a fuller 
understanding  of  them. 

Employing  the  methodology  used  in  the  Roberts/Chick  study 
a "new  look"  at  pilot  errors  was  attempted.  Because  the  author 
is  a qualified  P-3  pilot  with  more  than  2800  pilot  hours  in 
the  P-3  ORION  anti-submarine  patrol  aircraft,  the  study  is 
focused  on  P-3  pilots. 
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CHAPTER  II 


METHOD 

Preliminary  Testing  at  the  Naval  War  College 

The  author  selected  sixty  of  the  numerous  behaviors 
relating  to  all  aspects  of  P-3  piloting  and  typed  these 
behaviors  on  3 by  5 cards.  The  behaviors  selected  were 
those  normally  accomplished  by  the  pilot  and  represent 
actions  which  occur  in  all  phases  of  P-3  operations.  The 
sixty  behaviors  are  listed  in  Table  I. 

The  initial  feasibility  of  mapping  similarity  matrices 
for  the  clustering  was  obtained  by  giving  the  shuffled  card 
deck  to  P-3  pilots  stationed  at  the  Naval  War  College  or  in 
the  Newport  area  and  asking  them  to  sort  the  cards  into  two 
or  more  piles  on  the  basis  of  the  similarity  which  the 
behaviors  had  for  each  other.  The  minimum  and  maximum  numbers 
of  piles  obtained  through  this  procedure  were  two  and  eleven. 
The  sorting  task  was  accomplished  by  twenty-three  P-3  pilots 
with  varying  fleet  experience  and  currency  in  the  aircraft. 

The  twenty-three  similarity  matrices  were  then  summed  to 
produce  the  aggregate  matrix  which  was  entered  into  the 
clustering  program.  This  aggregate  matrix  was  clustered  using 
the  U-statistic  clustering  technique.^-  This  technique  is  a 
non-parametric  method  of  hierarchical  clustering  which  groups 
on  the  basis  of  the  best  mean  rank  of  proximity  scores 
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TABLE  I 

SIXTY  P-3  PILOT  BEHAVIORS 


I PERFORM  A NO  FLAP  LAIC  INC 

EXTEND  THE  LAIC  INC  OAR  WITHOUT  ELECTRICAL  ROWS 

:u;  XT'  AN  ENGINE  DUE  TO  TO  SYSTEM  MALFUNCTIX 

GIVL  THE  U»WAND  TO  'E'  HANDLE  AN  ENGINE  E’*  IjOW  OIL  PRESSUPC 

FERE  DEW  A THREE  ENGINE  FERRY  TAKEOT 

STOP  IKE  AIRCRAFT  DUE  TO  BRAKE  FIRE 

PKRFOfM  AN  ACTUAL  THREE:  EICINE  I AND  INC 

LAUD  THE  AIRCRAFT  WITH  A FLAT  TIRE  ON  THE  MAIN  HXIMT 

ET.Y  ACTUAL  IN.STHJMENTS  X PARTIAL  PANEL 

ABORT  THE  TAKEOFF  AT  80  KNOTS 

I AND  THE  AIRCRAFT  LCfaNWIND 

I AND  THE  AIRCRAFT  ON  A SHORT  RUNWAY 

iANLi  THE  AIRCRAFT  XI  AN  ICY  RUNWAY 

LAND  THE  AIRCRAFT  AT  NIGET 

LAND  THE  AIRCRAFT  IN  A CROSSWIND 

POET  FLIGHT  THE  AIRCRAFT 

FILL  OUT  THE  YELLOW  SHEET 

SECURE  ALL  THE  RADI06 

SET  THE  PARKING  BRAKE  IN  THE  OECKS 

PITT  CREW  IN  DITCHING  STATIONS  EUR  TAKEOFF 

OCCK  THE  FLAPS  SET  FOR  TAKEOFF 

CMC*  THE  TRIM  TABS  SET  FOR  TAKEOET 

(3«CK  BRAKE'S  DURING  TAXI 

OfiCX  THE  TITO  INDICATORS  AND  COMPASSES  XI  TAXI 
CMC*  FLIGHT  CONTROLS  FOR  E'REEIXM  DURPJG  TAXI 
INSURE  THAT  THE  TAKEOFF'  CHECK  LIST  IS  COMPLETE 
SET  YOUR  RADIOS  AND  HSI  TO  CARR1*'  GUT  YOKR  TL  INBOUT 
SET  YOUR  SEAT  BELT  AND  SICULDFR  HAINESS 
ADJUST  YOUR  SEA! 

CALL  IOR  Tia.  BEFORE  .START!  CHECK  LIST- 

CALL  FOR  the;  aetep  start  check  list 
SIGNAL  "CHJCKS  XT"  TO  THE  LINEMAN 
OBSERVE  ENGINE.  START  TEMPERATURES  AMJ  RTM'S 
PREFLIGEfT  THE  AIRCRAFT 

BRIEF  THE  CREJv  BEFORE  DEPARTING  ON  MISSION 
FIT  THE  PARACHITL  Alt)  STOW  IT 
CALL  FOR  GEAR  UP 
CALL  FOR  MAX  POWER 

MAINTAIN  DIRECTIONAL  CONTROL  CN  TAKECFF  ROLL 
AEAIANCL  THE  POWER  LEVERS  TO  BEE  IN  THE  TAKECFF 
ROTATE  THE  AIRCRAFT  DURING  TAKEOFF 
ESTABLISH  THE  CLIMB 

LINE  [ T*  THE:  AIRCRAFT  'IN  RUNWAY  (FNTERLINE  FOR  1AKE0FF 
CAIL  FOR  Nib  :Ma 

BRIEF  COCKPIT  CREW  ON  LANDING  BROCHURE" 

ALL  FOP  DEL'.  INI  CHECK  LIST 

CHECK  ALTIMETER  SETTING  AND  READ  BACK  BEFORE  DESCENT 

-«rr/-  " LANDING  WEIGIT  AND  SPEEDS 

CHECK  .HE.  BRAKE.'  AFTER  GEAR  DCWI  XI  FINAL 

■GAIL  EX'H  ! AX)  INC  F LAI'S 

GAU  FOR  APPROACH  FIVE'S 

SHUT  AN  ACTUAL  GCA 

TRANSITION  E'RM  INSTRLMIMTS  IX'  VISIAL.  WHEN  CXTTACT 

hevir.se:  the  props  xi  landing  ioig. 

PASE  the:  rvVIER  AS  lANDINLI  FLARF  IS  ESTABLISHED 

MAINTAIN  DIRECT'D  *NAJ.  OXTHOL  XI  R3LLEXT  BY  VARYING  REVERSE 

TURN  iFI  THE:  EUNWAY 

SWITCH  LEFT  HAND  FRM  YOKE  TO  IWSEWHEEL  STEERING  XI  ROLL  OUT 
RESET  D WFR  AFTER  DISCEMT  TO  VECTOR  ALTITUDE 
RIDUCT  lOWTR  FOP  DESCENT 
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connecting  potential  clusters.  The  hierarchical  clustering 
solution  obtained  from  the  computer  is  depicted  in  Figure 
1. 

Next,  a small  number  of  P-3  pilots  examined  the  clustering 

solution  presented  in  Figure  1 and  agreed  that  the  clustering 

2 

seemed  logical  and  it  fitted  their  experience  in  P-3  flying. 

Three  major  clusters  were  accordingly  identified,  agreed 
to  by  the  experts  and  titled: 

I.  Difficulty  Cluster 

II.  Assurance/Checking  Cluster 

III.  Stress  Cluster  (Sequential  Flying  Cluster) 

I.  Difficulty  Cluster.  The  uppermost  cluster  of 
fifteen  behaviors  represents  behaviors  that  to  a degree  are 
difficult  to  perform  and  require  a degree  of  skill,  knowledge 
and  airmanship  to  accomplish.  In  general  these  behaviors  rep- 
resent problems  and  malfunctions  that  confront  the  pilot  in 
non-routine  situations.  Examples  are:  LAND  THE  AIRCRAFT  ON  AN 
ICY  RUNWAY  and  PERFORM  A NO  FLAP  LANDING. 

II.  Assurance  Cluster.  The  center  cluster  of  twenty- 
one  behaviors  represents  an  assurance  or  checking  group  of 
behaviors.  These  are  behaviors  that  are  undertaken  to  ensure 
that  the  flight  will  be  carried  out  properly  and  safely. 

Most  are  accomplished  before  takeoff,  although  a few  occur 
after  landing  but  are  still  required  for  the  proper  prosecu- 
tion of  the  flight.  Examples  are:  CHECK  BRAKES  DURING  TAXI 
and  PREFLIGHT  THE  AIRCRAFT. 
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FIGURE  I 


NEWPORT  AREA  P-3  PILOTS  CLUSTERING  OF  BEHAVIORS 


PERFORM  A NO  FLAP  LANDING 

EXTEND  THE  LANDING  GEAR  WITHOUT  ELECTRICAL  PCMER 

NULL  OUT  AN  ENGINE  DUE  TO  TD  SYSTEM  MALFUNCTION 

GIVE  TOE  036WAND  TO  'E'  HANDLE  At;  ENGINE  FOP  I£W  OIL  PRESSURI 

PERFORM  A THREE  ENGINE  FERRY  TAKEOFF 

STOP  THE  AIRCRAFT'  DUE  TO  BRAKE  FIRE 

PERFuIM  AN  ACTUAL  THREE  ENGINE  LANDING 

LAND  THE  AIRCRAFT  WITH  A FLAT  TIRE  Of.  THE  MAIN  MOUNT 

FLY  ACTUAL  INSTRUMENTS  CN  PARTIAI,  PANEL 

ABORT  TIE  TAKEOFF  AT  80  KNOTS 

LAND  THE  AIRCRAFT  DOWNWIND 

LAND  THE  AIRCRAFT  ON  A SHORT  RUNWAY 

LAND  THE  AIRCRAFT  ON  AN  ICY  RUNWAY 

LAND  THE  AIRCRAFT  AT  NIGHT 

LAND  THE  AIRCRAFT  IN  A CROSSWIND 

POST  FLIGHT  THE  AIRCRAFT 


FILL  OUT  THE  YELLOW  SHEFII 

SECURE  ALL  THE  RADIOS 

SET  THE  PARKING  BRAKE  IN  TIE  CHOCKS 

PUT  CREW  IN  DITCHING  STATIONS  FOR  TAKEOFF 

CHECK  THE  FLAPS  SET  FOR  TAKEOFF 

CHECK  THE  TRIM  TABS  SET  FOR  TAKEOFF 

CHECK  BRAKES  DURING  TAXI 

CHECK  THE  TURN  INDICATORS  AND  COMPASSES  0!.  TAXI 
CHECK  FLIGHT  CONTROLS  FOR  FREEDOM  DURING  TAXI 
INSURE  THAT  THE  TAKEOFF  CHECK  LIST  IS  COMPLETE 
SET  YOUR  RADIOS  A'©  HSI  TO  CARRY  OUT  YOUR  CLIMBOOT 
SET  YOUR  SEAT  BEIT  AND  SIOULDER  HARNESS 
ADJUST  YOUR  SEAT 

CALL  FOR  THE  BEFORE  STAR!  CHECK  LIST 
CALL  FOR  THE  AFTER  START  CHECK  LIST 
SIGNAL  "CHOCKS  OUT"  TO  THE  LINEMAN 
OBSERVE  ENGINE  START  TEMPERATURES  A©  RIM'S 


PREFLIGHT  TOE  AIRCRAFT 

BRIEF  THE  CREW  BEFORE  DEPARTING  ON  MISSION 

FIT  THE  PARACHUTE  AND  STOW  IT 
CALL  FOR  GEAR  UP 
CALL  FOR  MAX  POWER 


:;i  re  s 
Cl  tl!»  I 


MAINTAIN  DIRECTIONAL  CDNTF80L  ON  TAKSOFF  ROLL 
ADVANCE  THE  POWER  IEVERS  TO  BEGIN  THE  TAKEOFF 
ROTATE  THE  AIRCRAFT  DURING  TAKEOFF' 

ESTABLISH  THE  CLIMB 

LINE  UP  THE  AIRCRAFT  ON  RUNWAY  CENTERLINE  FOR  TAKEOFF' 

CALL  FOR  NTS  CHECK 

BRIEF  COCKPIT  CREW  ON  IANDING  PWXUuUkJ 
CALL  FOR  DESCENT  CHECK  LIST 

CHECK  ALTIMETER  SETTING  AND  i<EAL  liACE  BUNIJ.  ULSC2NT 

OBTAIN  IANDING  WI.IGIfT  AND  LI  ’Kill 

CHECK  THE  BRAKES  AFTER  GEAR  I/M  it.  : LA; 

CALL  FOR  IA‘©ING  HAPS 
CALI,  FOR  APPROACH  FLAPS 
SHOOT  AN  ACTUAL  GCA 

TRANSITION  FROM  INSTRUMENTS  TO  VISUAL  WHEN  CONTACT 

REVERSE  THE  PROPS  ON  LANDING  ROLL 

EASE  THE  TOWER  AS  IANDING  FLARF  IS  ESTABLISHED 

MAINTAIN  DIRECTIONAL  CONTROL  ON  ROLLOUT  BY  VARYING  REVERSF 

TURN  OFF  TOE  RUNWAY 

SWITCH  LEFT  HAND  FROM  YOKE  TO  NOSEWHLLL  STEERING  JN  ROLL  OUT 
RESET  POWER  AFTER  DESCENT  TO  VECTOR  ALTITUDE 
REDUCE  !UWER  FOR  DESCENT 
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III.  Stress  Cluster.  The  lower  cluster  of  twenty-four 
behaviors  is  sequential  in  nature  and  appears  to  proceed 
from  takeoff  to  landinq.  Most  of  the  behaviors  in  this  clus- 
ter have  to  do  with  normal  flyinq,  involving  manipulation 
of  the  controls,  changing  the  status  of  the  aircraft  or  giving 
the  orders  for  manipulation  of  the  controls.  The  sequential 
nature  of  the  cluster  provoked  further  speculation  that  any 
flight  produces  stress  that  increases  from  takeoff  to  landing. 
Consequently,  this  grouping  was  also  tentatively  labeled  a 
stress  cluster.  Examples  are:  ROTATE  THE  AIRCRAFT  DURING 
TAKEOFF,  ESTABLISH  THE  CLIMB,  CALL  FOR  DESCENT  CHECKLIST  and 
TURN  OFF  THE  RUNWAY. 

Subclusters  within  a major  cluster  can  be  identified, 
such  as  landing  cluster  of  five  behaviors  at  the  bottom  of 
the  Difficulty  Cluster  (Figure  1,  lines  11  through  15).  These 
subclusters  were  not  examined  closely  in  this  preliminary 
testing,  however,  and  will  require  further  analysis  in  sub- 
sequent studies. 

Since  the  three  major  clusters  defined  an  overall  pat- 
tern that  seemed  to  make  sense  to  P-3  pilots,  the  60  be- 
havior as  sorted  by  the  pilots  were  next  subjected  to  multi- 
dimensional scaling  to  search  for  the  structure  or  domain  of 
the  clusters.3  Figures  2,  3 and  4,  with  accompanying  Tables 
II,  III,  and  IV,  show  the  results  of  this  scaling  in  three- 
dimensional  interpoint  distance  representation.  Separate 
figures  and  tables  for  each  cluster  were  drawn  to  show  a less 
cluttered  representation  of  the  clusters  within  the  space  of 
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the  total  sixty  behaviors.  An  examination  of  each  of  the 
three  figures  shows  that  the  behaviors  do  cluster,  each 
group  occupying  its  own  "space"  within  the  total  space.  The 
key  for  the  letters  appearing  in  Figure  2 is  given  in  Table 
II.  A similar  usage  holds  for  Figures  3 and  4 where  the 
keys  appear  in  Tables  III  and  IV. 

Each  cluster  was  then  multidimensionally  scaled  sepa- 
rately, and  certain  dimensions  were  identifiable  but  will  not 
be  treated  here  since  further  research  centering  on  errors 
was  desired. 

The  sorting  accomplished  by  the  initial  twenty-three 
War  College/Newport  Pilots  served  as  a pre-testing  experiment 
and  demonstrated  that  the  sixty  behaviors  were  meaningful 
to  all,  and  since  they  had  form  and  structure,  they  were 
cognitively  mapped  within  the  pilots'  minds.  This  informa- 
tion indicated  that  further  probing  in  the  more  narrow  field 
of  errors  was  possible. 

To  prepare  for  field  testing,  an  array  of  seventy  er- 
rors was  compiled  from  a Naval  Safety  Center  statistical 
printout  of  pilot  factor  accidents  and  incidents,  and  from 
the  author's  flying  experience.  The  change  from  sixty  to 
seventy  errors  represented  an  attempt  to  increase  the  number 
in  the  action  space,  allowing  more  opportunity  for  definitive 
clustering. 

The  seventy  errors  were  pre-tested  on  seven  War  College 
P-3  pilots  in  much  the  same  manner  as  before,  except  that  the 
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TABLE  II 


DIFFICULTY  CLUSTER 


Behaviors  Dimensions 


A. 

Far form  a no-flap  landing 

I 

-1 . 385 

II 

0.014 

III 

-0.274 

B. 

Extend  the  landing  gear  without 
electrical  power 

-1.396 

-0.616 

0.248 

C. 

Perform  a three-engine  ferry  takeoff 

-1.582 

-0.299 

-0.120 

D. 

Stop  A/C  due  to  brake  fire 

-1.539 

-0.410 

0.034 

E. 

Land  the  A/C  downwind 

-1.404 

0.230 

-0.266 

F. 

Abort  the  takeoff  at  80  kts. 

-1.084 

-0.2  33 

0,263 

G. 

Give  the  coiruriand  to  "E"  handle 
an  engine  for  low  oil  pressure 

-1 . 317 

-0.742 

0 .066 

H. 

Null  out  an  engine  due  to  TD  mal- 
function 

-1.401 

-0 .646 

-0  .005 

I. 

Land  the  A/C  with  a flat  tire  on 
the  main  mount 

-1.660 

-0 . 320 

-0.016 

J. 

Land  the  A/C  at  night 

-0.594 

0.573 

-0.237 

K. 

Land  the  A/C  in  a crosswind 

-0.813 

0 .468 

-0 .209 

L. 

Land  the  A/C  on  an  icy  runway 

-1.423 

0.235 

-0.058 

M. 

Fly  actual  instruments  on  partial 
panel 

-1.542 

-0 .178 

0.067 

N. 

Perform  an  actual  three-engine 
landing 

-1.447 

-0.297 

-0.114 

0. 

Land  the  A/C  on  a short 
runway 

-1.297 

0.421 

-0.088 
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TABLE  III 


ASSURANCE/CHECKING  CLUSTER 


A. 

B. 

C. 


D. 

E. 


F. 

G. 

H. 

I. 

J. 

K. 

L. 

M. 

N. 

O. 

P. 

Q. 

R. 

S . 

T. 


U. 


Behaviors 

Dimensions 

I 

II 

III 

Post- flight  the  A/C 

0.405 

-0.060 

-0.927 

Fill  out  the  yellow  sheet 

Put  the  crew  in  ditching  stations 

0.710 

-0.190 

-0.757 

for  takeoff 

1.195 

-0.164 

-0.012 

Set  parking  brake  in  chocks 

Set  seat  belt  and  shoulder 

0.798 

0.237 

-0 .617 

harness 

0.763 

-0.490 

0.097 

Preflight  the  A/C 

Brief  crew  prior  to  departing  on 

0.638 

-0.660 

-0.325 

mission 

0 .618 

-0.786 

-0 .239 

Adjust  your  seat 

0.797 

-0.282 

-0.055 

Call  for  before-start  check  list 

0.731 

-0.459 

-0 . 129 

Call  for  after-start  check  list 

0.756 

-0.36  3 

-0.057 

Check  brakes  during  taxi 

Observe  engine  start  temperatures 

0.912 

-0.249 

0.146 

and  RPM's 

0.334 

-0.513 

0.093 

Fit  the  parachute  and  stow  it 

0.819 

-0 . 719 

-0 . 322 

Check  the  flaps  set  for  takeoff 

Check  turn  indicators  and  compasses 

0.933 

-0.012 

0.180 

on  taxi 

0.918 

-0.333 

0.174 

Secure  all  radios 

0.532 

-0.048 

-0.880 

Signal  "chocks  out"  to  lineman 

0 .734 

-0 . 400 

-0.133 

Check  trim  tabs  set  for  t akroli 

Check  flight  controls  lor  freedom 

0.878 

-0.143 

0.213 

during  taxi 

Insure  that  the  takeoff  check  list 

0 . 768 

-0 .468 

0.235 

is  complete 

Set  radios  and  HSI  to  carry  out 

0 768 

-0.283 

0 .210 

c 1 i inbout 

0 . 780 

-0.137 

0 . 351 
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TABLE  IV 


STRESS  CLUSTER  (SEQUENTIAL  FLYING  CLUSTER) 


Behaviors 


Dimensions 


A. 

Call  for  gear  up 

I 

0.602 

II 

0.277 

III 

0.532 

B. 

Call  for  max  power 

0.534 

0.155 

0.571 

C. 

Call  for  NTS  check 

0.265 

0.318 

0.747 

D. 

Brief  cockpit  crew  on  landing 
procedure 

0 .459 

0.310 

-0  .202 

E. 

Shoot  an  actual  GCA 

-0.584 

0.368 

-0.205 

F. 

Check  brakes  after  gear  down  on 
final 

0.410 

0.627 

-0.209 

G. 

Maintain  directional  control  on 
takeoff 

-0.053 

0 .041 

0 .539 

H. 

Call  for  descent  check  list 

0.559 

0 .385 

-0.140 

I. 

Reverse  props  on  landing  roll 

-0.015 

0.574 

0.115 

J. 

Transition  from  instruments  to 
visual  when  contact 

-0.471 

0.634 

-0.081 

K. 

Check  altimeter  and  read  back 
before  descent 

0.516 

0.454 

-0.373 

L. 

Reset  power  after  descent  to  vector 
altitude 

0.058 

0 .339 

-0.050 

M. 

Advance  P/L  to  begin  takeoff 

0.111 

0.029 

0 .545 

N. 

Call  for  landing  flaps 

0.240 

0.505 

0.046 

0. 

Turn  off  the  runway 

0.178 

0.262 

-0.255 

P. 

Rotate  A/C  during  takeoff 

0 .032 

-0.013 

0.500 

Q. 

Establish  the  climb 

0.006 

0.066 

0.565 

R. 

Obtain  landing  weight  and  speeds 

0.587 

0.446 

-0.096 

s. 

Reduce  power  for  descent 

0.201 

0.449 

-0.042 

T. 

Call  for  approach  flaps 

0 .436 

0.727 

0.041 

U. 

Switch  left  hand  to  nose  wheel 
steering  on  rollout 

0.067 

0.455 

0.295 

V. 

Maintain  directional  control  on  roll- 
out by  varying  reverse 

-0.34  8 

0.554 

0.079 

W. 

Line  up  A/C  on  runway  centerline 
for  takeoff 

0.304 

-0.10  7 

0.496 

X. 

Ease  the  power  as  flare  is  estab- 
lished 

0.002 

0.468 

0.046 
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pilots  were  asked  to  return  more  than  two  piles,  to  get 
greater  definition.  Some  of  these  pilots  had  sorted  the 
first  sixty  behaviors,  and  some  were  unfamiliar  with  the 
procedure.  In  addition,  the  seven  pilots  were  asked  to 
sort  an  identical  card  deck  into  seven  slots  in  a box, 
ranking  the  errors  from  "most  serious"  to  "least  serious." 
Cards  already  slotted  could  be  seen  by  the  sorter  and  could 
be  changed  to  another  slot  if  desired.  The  seventy  errors 
did  show  distinct  clusters,  and  the  seriousness  ranking 
seemed  sufficiently  promising  to  justify  field  testing.  It 
was  decided,  however,  that  the  increase  from  sixty  to  seventy 
errors  made  the  task  prohibitively  cumbersome,  and  a decision 
was  made  to  employ  only  sixty  errors.  The  ten  errors 
dropped  were  selected  because  they  were  very  similar  to  an 
error  already  in  the  deck  or  because  they  were  very  general 
in  nature. 


CHAPTER  III 


THE  FIRST  FLEET  PILOT  STUDY 

Fifty-one  P-3  pilots  ranging  in  age  from  24  to  43  and 
in  P-3  pilot  hours  from  40  to  4000  were  surveyed  at  a major 
patrol  squadron  base  in  February  1978.  As  in  the  preliminary 
error  study,  the  pilots  were  asked  to  sort  the  errors  into 
more  than  two  piles,  based  upon  their  perception  of  how  the 
errors  related  to  each  other. 

No  time  limit  was  imposed  nor  was  there  a limit  on  the 
number  of  piles  a respondent  could  make.  The  pilots  were 
assured  anonymity  and  told  only  that  the  sorting  was  for  a 
survey  related  to  aviation  safety.  They  were  also  asked  to 
sort  the  same  60  errors  into  seven  slots  in  a box,  ranging 
from  " most  serious"  to  "least  serious." 

The  clustering  solution  for  the  errors  sorted  by  the 
51  pilots  is  shown  in  Figure  5.  This  solution  was  examined 
by  several  War  College  P-3  pilots  who  aided  in  naming  the 
major  clusters  and  sub-clusters.  The  three  major  clusters 
were  titled: 

I.  Unacceptable  Errors 

II.  Acceptable  Errors 

III.  Runway  Environment  Technique  Errors 
I.  Unacceptable  Errors.  The  uppermost  cluster  of 
18  errors  is  a grouping  of  errors  that  are  "killers."  These 
errors  are  highly  unacceptable  to  most  pilots,  even  though 
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FLY  INTO  A KNOWN  THUNDERSTORM  AREA. 

FLIGHT  SHOUID  NOT  HAV1  HIM  HI*;,  WIATIII  . 

GO  TFR  ON  A VFR  CTDARANOE. 

UtTURY  RESULTS  TO  CREWMAN  FMM  PILOT  1MICUJ  AIM  :(A!  *1  MANEUVERS. 

CREWMAN  INJURED  DURING  HEAVY  MATHER  PLYING. 

ALLOW  CREW  ENTRY  INTO  WAD  CENTER  DURING  ELICIT. 

CONTINUE  FLIGHT  WITH  HAIL  DAMAGED  AIRCRAFT. 

TAKE  OFF  WITH  DOWNING  DISCREPANCY. 

MAKE  A WHEELS  UP  PASS. 

ATTEMPT  AN  ABORT  AFTER  REFUSAL  WHEN  ENGINE  FAILS. 

ABORT  TAKEOFF  BEYOND  REFUSAL  SPEED  WHEN  EMGKL  KLMLVAL  DTOR  lOPS  OPEN . 

DISCHARGE  HRD  INTO  WRONG  ENGINE  DUPING  TRANSFER. 

CALL  FOR  WRUNG  ENGINE  TO  HE  FEATHERED. 

FLY  BELOW  GCA  MINIMJMS  UN  ACTUAL  APPROACH. 

DESCENT  THROUGH  200  FT  IN  DAYTIME  MAD  PATTERN. 

LET  AIRCRAFT  DESCEND  BELOW  SAFE  ALTITUDE  AT  NIGHT. 

FAIL  TO  MAINTAIN  SAFE  FLYING  SPEED,  ENTER  UNCONTROLLED  FLIGEfT. 

CONFUSION  AS  TO  IFR  ALTITUDE  ASSIQMENT,  NEAR  MISS. 

FAILURE  TO  NOTE  "VOR  OFF"  FLAG. 

FAILURE  TO  USE  ALL  AVAILABLE  NAV  AIDS  TO  DETERMINE  POSITION. 

TAKE  CFF  WITH  FLAPS  NOT  SET  AT  "TAKE-OFF  AND  APPROACH." 

TAKE  CFF  WITH  TRIM  TABS  SET  IMPROPERLY. 

CHECK  LIST  NOT  OMPLETED. 

RESTART  AN  ENGINE  IN-FLIGHT  WITH  CIRCUIT  BREAKERS  NUT  PROPERLY  RESET. 

EXCEED  DESIGN  AIRSPEED  FOR  F’LAP  SETTING. 

ALLOW  PROP  WASH  TO  CAUSE  DAMAGE  TO  OTHER  AIRCRAFT. 

RAISING  GEAR  BEFORE  BRAKES  CXXJL  BLOWING  THERMAL  PLUGS. 

UNABLE  TO  RAISE  GEAR  DUE  TO  GEAR  PINS  BEING  LEFT  IN. 

FUELING/AGCESS  PANEL  NOT  PROPERLY  SECURED  FOR  FLIGHT. 

INGEST  ENGINE  INTAKE  COVER  DURING  NIGHT  START. 

TAKE  OFF  WITH  PITOT  COVERS  LEFT  ON. 

SET  UP  RADI0S/HS1  WRCNG  FOR  CLIMBOUT  CLEARANCE. 

MISREAD  ALTIMETER. 

ALLOW  CABIN  ALTITUDE  TO  EXCEED  10,000  FT. 

DECLARE  A LOW  FUEL  STATE  DUE  TO  HEADWINDS. 

ALLOW  IMPROPER  FUEL  TRANSFER  PROCEDURES. 

IMPROPER  USE  CF  DEICING  EQUIPMENT. 

NOT  RECOCMIZING  A PITCHL3CK  CONDITION. 

DBOOUPLE  THE  PROP  DUE  TO  EXCESSIVE  AIRSPEED  CM  RESTART. 

NOT  INVESTIGATING  CAUSE  CF  "ANTI  ICE"  LIGHT  ILLUMINATION. 

SECURE  AN  ENGINE  IN-FLIGHT  PRIOR  TO  DETERMINING  IF  ACTUAL  MALFUNCTION  EXISTS. 
NOT  SECURING  ENGINE  START  WHEN  RIFED  AIR  DID  NOT  RETUWJ  TO  PRE-START  PRESSURE. 
ATTEMPT  TO  START  A DECOUPLED  ENGINE. 

SALVAGE  A LANDING  FROM  A POOP.  APPROACH  THAT  SHOUID  HAVE  BEEN  A WAVE -OFF. 
ACCOMPLISH  AN  UNAUTHORIZED  OVERWEIGHT  LANDING. 

RAISE  THE  IANDING  GEAR  PREMATURELY. 

TAXI  THE  AIRCRAFT  INTO  A SNOW  BANK. 

TAXI  CFF  THE  TAXIWAY  AT  NIGHT. 

TURN  OFF  RUNWAY  TOO  FAST,  BLOW  TIRE. 

MAKE  A HARD  LANDING,  "G"  METER  EXCEEDS  5.2  "G’s." 

ALLCW  PROP  TO  CONTACT  RUNWAY  DURING  CROSSWIND  LANDING. 

REVERSING  TOO  FAST  ON  NO  FLAP  IANDING,  PITCHL0CKED  PR OP. 

SHUT  HAND  TO  NOSE  WHEEL  STEERING  TOO  SOON. 

FIARE  TOO  HIGH. 

OVER  ROTATE  ON  TAKEOFF. 

APPLYING  TOO  MUCH  BRAKE  CN  IANDING  ROLLOUT. 

TAP  BRAKE  WHILE  APPLYING  RUDDER  ON  ROLLOUT. 

RETRACT  GEAR  BEFORE  FTAP  DURING  A WAVE-OFF’. 

INDUCE  AN  AOTCFEATHER  BY  RAPID  MOVEMENT  OF  P/L. 

OVERTEMP  Mi  ENGINE  BY  RAPID  MOVEMENT  OF  P/L. 


most  pilots  will  admit  to  having  committed  at  least  some 
of  these  errors  and  survived  or  escaped  having  an  accident. 
Examples  are:  FLY  INTO  A KNOWN  THUNDERSTORM  AREA  and 
CONFUSION  AS  TO  IFR  ALTITUDE  ASSIGNMENT,  NEAR  MISS. 

Sub-cluster  I.  The  upper  sub-cluster  of  nine 
errors  that  are  deliberate  errors,  errors  that  the  pilot 
has  time  to  ponder  before  committing.  They  are,  then, 
errors  where  a judgment  factor  or  headwork  comes  into  play. 
Examples  are:  FLIGHT  SHOULD  NOT  HAVE  BEEN  FLOWN,  WEATHER 
and  TAKE  OFF  WITH  A DOWNING  DISCREPANCY. 

Sub-cluster  2.  The  lower  sub-cluster  of  nine 
errors  are  spur-of-the-moment  errors.  These  errors  occur 
as  a result  of  necessarily  rapid  decisions  or  actions  on 
the  part  of  the  pilot.  Judgment  is  less  a factor  here  than 
reaction  to  stimuli  or  fast  moving  events.  Examples  are: 
CALL  FOR  THE  WRONG  ENGINE  TO  BE  FEATHERED  and  ATTEMPT  AN 
ABORT  AFTER  REFUSAL  WHEN  ENGINE  FAILS. 

II.  Acceptable  Errors.  The  center  cluster  of  25 
errors  is  a grouping  of  errors  that  are  more  acceptable 
to  pilots.  These  errors  are  more  common  and  occur  more 
frequently.  They  are  expected  from  less  experienced  pilots 
and  watched  for  and  anticipated  by  senior  pilots  in  the 
instructor  role.  Many  pilots  have  committed  these  errors 
or  witnessed  the  commission  thereof.  In  some  cases,  these 
errors  have  occurred  and  escaped  detection  by  supervisory 
authority  when  no  damage  or  injury  resulted  from  the  error. 
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Examples  are:  TAKE  OFF  WITH  PITOT  COVERS  LEFT  ON  and 
SECURE  AN  ENGINE  IN-FLIGHT  PRIOR  TO  DETERMINING  IF  ACTUAL 
MALFUNCTION  EXISTS. 

Sub-cluster  3.  The  upper  sub-cluster  of  17  errors 
appears  to  be  a grouping  of  inattention  or  distraction 
errors.  These  are  items  that  a pilot  should  have  detected, 
but  through  inattention,  temporary  distraction,  stress, 
fatigue  or  a break  in  habit  pattern,  the  occurrence  is 
missed  or  the  pilot  errs  in  the  action  required  by  the 
event.  Examples  are:  CHECK  LIST  NOT  COMPLETED  and  TAKE 
OFF  WITH  PITOT  COVERS  LEFT  ON. 

The  first  two  errors  of  this  sub-cluster,  FAILURE 
TO  NOTE  "VOR  OFF"  FLAG  and  FAILURE  TO  USE  ALL  AVAILABLE  NAV 
AIDS...  are  "outlyers"  i.e.,  although  joined  with  each  other 
at  the  first  level,  they  are  not  joined  in  another  grouping 
until  the  seventh  level.  It  is  difficult  to  determine  the 
reason  for  this  unless  the  errors  were  semantically  segre- 
gated by  reason  of  the  first  word,  "FAILURE." 

Sub-cluster  4.  This  sub-cluster  of  eight  errors 
appears  to  involve  a lack  of  knowledge  of  the  aircraft  systems. 
Pilots  may  also  feel  that  the  responsibility  for  these  errors 
lies  at  least  partially  with  other  crew  members  such  as  the 
Flight  Engineer  or  the  Co-pilot;  clearly  though,  these  errors 
relate  to  aircraft  systems  knowledge.  Examples  are:  IMPROPER 
USE  OF  DEICING  EQUIPMENT  and  ATTEMPT  TO  START  A DECOUPLED 
ENGINE. 
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III.  Runway  Environment  Technique  Errors.  The  lower  major 
cluster  of  17  errors  is  a grouping  of  errors  that  occur  in 
the  runway  environment  and  are  mostly  technique  errors  on 
the  part  of  the  pilot.  Most  of  these  errors  reflect  hands- 
on  operation  of  the  aircraft  controls  and  occur  in  the  action 
of  changing  the  status  of  the  aircraft,  i.e.,  a change  from 
airborne  status  to  on-the-ground  operation  or  vice  versa. 
Examples  are:  FLARE  TOO  HIGH  and  RAISE  THE  LANDING  GEAR 
PREMATURELY. 

Sub-cluster  5.  This  upper  sub-cluster  of  nine 
errors  represents  a group  of  errors  wherein  an  outside 
influence,  such  as  wind,  snow,  lack  of  daylight,  or  short- 
ness of  runway,  contributes  to  the  occurrence  of  the  error. 

In  these  cases,  then,  there  are  other  than  routine  factors 
that  are  involved  or  contribute  to  the  occurrence  of  the 
error.  Examples  are:  TAXI  THE  AIRCRAFT  INTO  A SNOW  BANK 
and  ALLOW  PROP  TO  CONTACT  RUNWAY  DURING  CROSSWIND  LANDING. 

As  in  sub-cluster  3,  there  are  two  "outlayers"  found  in 
this  sub-cluster.  The  first  two  errors,  SALVAGE  A LANDING 
FROM  A POOR  APPROACH  THAT  SHOULD  HAVE  BEEN  A WAVE  OFF  and 
ACCOMPLISH  AN  UNAUTHORIZED  OVERWEIGHT  LANDING,  are  joined 
with  each  other  at  the  first  level  but  do  not  join  again 
until  the  seventh  level.  A possible  explanation  here  is 
that  both  these  errors  have  a strong  success  factor  involved 
in  their  occurrence,  which  is  to  say  that  if  a pilot  can  skill 
fully  salvage  a landing  from  a poor  approach  or  land  an 
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overweight  aircraft  smoothly,  he  experiences  some  positive 
affect  from  the  action.  (The  phenomenon  of  positive  affect 
resulting  from  an  error  will  be  examined  further  in  the 
Second  Fleet  Pilot  Study.) 

Sub-cluster  6.  This  lower  sub-cluster  of  eight, 
errors  is  a grouping  of  motor-skill  errors.  The  pilot 
technique  displayed  in  committing  these  errors  reflects  a 
lack  of  hand,  eye,  and  brain  coordination.  These  errors 
may  be  associated  with  pilot  experience  levels.  Examples 
are:  SHIFT  HAND  TO  NOSE  WHEEL  STEERING  TOO  SOON  and  OVER 

ROTATE  ON  TAKEOFF. 

MULTIDIMENSIONAL  SCALING 

Each  of  the  major  clusters  was  separately  scaled  multi- 
dimensionally  in  an  attempt  to  identify  the  dimensions  of 
the  action  space.  Figures  6,  7,  and  8 with  accompanying 
Tables  V,  VI,  and  VII  represent  the  multidimensional  scaling 
solutions  for  each  separate  cluster.  Dimensions  for  each 
cluster  were  named  by  the  author. 

UNACCEPTABLE  ERRORS 

Dimension  I:  Decision  Time  Frame.  The  errors  in 
this  dimension  range  from,  I tern  (Q)  MAKE  A WHEELS  UP  PASS, 

(F)  ABORT  TAKE  OFF  BEYOND  REFUSAL  SPEED  WHEN  SMOKE  DOOR  POPS 
OPEN,  and  (D)  DISCHARGE  HRD  INTO  WRONG  ENGINE  DURING  TRANS- 
FER which  are  rapidly  occurring  events,  to  (R)  GO  IFR  ON  A 
VFR  CLEARANCE  and  (B)  FLIGHT  SHOULD  NOT  HAVE  BEEN  FLOWN, 


■ 
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RESPONSIBILITY  (ED 


Figure  6 


Three-dimentionol  representation  of  interpoint  distances 
among  the  18  Unacceptable  Errors . 
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TABLE 


V 


UNACCEPTABLE  errors 


Errors  Dimensions 


A. 

Fly  into  a known  thunderstorm  area 

I 

0.448 

II 

-0 . 317 

III 

-0  .272 

B. 

Flight  should  not  have  been  flown, 
weather 

0.963 

-0.381 

-0  .439 

C. 

Attempt  an  abort  after  refusal  when 
engine  fails 

-0.757 

0.371 

-0.457 

D. 

Discharge  HRD  into  wrong  engine 
during  transfer 

-0 .918 

0.907 

0 .172 

E. 

Fly  below  GCA  minimums  on  actual 
approach 

0 .091 

-0.525 

-0  .018 

F. 

Abort  takeoff  beyond  refusal  speed 
when  smoke  removal  door  pops  open 

-0.912 

0.463 

-0.359 

G. 

Injury  results  to  crewman  from  pilot- 
induced  aircraft  maneuvers 

0 .602 

0.415 

0.158 

H. 

Fail  to  maintain  safe  flying  speed, 
enter  uncontrolled  flight 

-0.600 

-0.20  3 

0.070 

I. 

Allow  crew  entry  into  load  center 
during  flight 

0.113 

0.316 

-0.351 

J. 

Descent  through  200FT  in  daytime 

MAD  pattern 

-0.178 

-0.100 

0.894 

K. 

Take  off  with  downing  discrepancy 

0.198 

-0 .006 

-0.879 

L. 

Crewman  injured  during  heavy 
weather  flying 

1.268 

1.075 

0.291 

M. 

Continue  flight  with  hail-damaged 
aircraft 

0.786 

-0.042 

-0.318 

N. 

Confusion  as  to  IFR  altitude 
assignment,  near  miss 

-0.094 

-0.575 

0.725 

0. 

Call  for  wrong  engine  to  be  feathered 

-0.700 

0.558 

0.451 

P. 

Let  aircraft  descend  below  safe 
altitude  at  night 

-0.469 

-0.791 

0.423 

Q. 

Make  a wheels -up  pass 

-0 .873 

-0.792 

-0.476 

R. 

Go  IFR  on  a VFR  clearance 

1.032 

-0.374 

0.385 
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TABLE  VI 


ACCEPTABLE  EFPORS 

Errors  Dimensions 


A. 

Failure  to  note  "VOR  OFF"  flag 

I 

-0.821 

II 

-0.6  73 

B . 

Take  off  with  flaps  not  set  at 
"take-off  and  approach" 

0 .705 

-0.4  32 

C. 

Allow  improper  fuel  transfer 
procedures 

-0  .577 

0 . 300 

D. 

Check  list  not  completed 

0.498 

-0.624 

E . 

Take  off  with  trim  tabs  set  im- 
properly 

0 .500 

-0.501 

F. 

Not  recognizing  a pitchlock  condition 

-0.268 

0.486 

G. 

Not  investigating  cause  of  "ANTI-ICE" 
light  illumination 

0.243 

0 . 306 

H. 

Secure  an  engine  in-flight  prior  to 
determining  if  actual  malfunction 
exists 

-0.220 

0.703 

I . 

Failure  to  use  all  available  navaids 
to  determine  position 

-0 .659 

-•  o44 

J. 

Attempt  to  start  a decoupled  engine 

-0.674 

1.007 

K. 

Decouple  the  prop  due  to  excessive 
airspeed  on  restart 

-0.008 

0 .835 

L. 

Restart  an  engine  in-flight  with  cir- 
cuit breakers  not  properly  reset 

0.275 

0.347 

M. 

Improper  use  of  de-icing  equipment 

-0.602 

0 .669 

N. 

Allow  prop  wash  to  cause  damage  to 
other  aircraft 

0.668 

0.111 

0. 

Set  up  radios/HSI  wrong  for  climbout 
clearance 

-0.251 

-1.142 

P. 

Allow  cabin  altitude  to  exceed 

10 ,000  feet 

-1.301 

-0.053 

Q. 

Not  securing  engine  start  when  bleed 
did  not  return  to  pre-start 
pressure 

0.439 

0.855 

R. 

Unable  to  raise  gear  due  to  gear  pins 
being  left  in 

0.963 

-0.271 

S. 

Fueling/access  panel  not  properly 
secured  for  flight 

0.832 

-0.096 

T. 

Declare  a low  fuel  state  due  to  head- 
winds 

-1.061 

-0 .59  8 

U. 

Exceed  design  airspeed  for  flap  setting 

-0.30  3 

0.221 

V. 

Ingest  engine  intake  cover  during 
night  start 

0 .907 

-0  .271 

W. 

Take  off  with  pitot  covers  left  on 

1.015 

-0.149 

X. 

Raising  gear  before  brakes  cool  blowing 
thermal  plugs 

0.247 

0.529 

Y. 

Misread  altimeter 

-0.547 

-0.914 




III 

-0.490 

0 .691 

-0.157 

0.526 

0.136 
0 .648 

0 .695 

0.207 

-0.831 

0.508 

0.053 

•0.119 

■0.449 

■0  .740 

0 .291 

0.065 

0.168 
■0 .0  30 

0.411 

0 .697 

0.688 

0.293 
0 .163 

0.594 

■0.048 


TABLE  VII 


RUNWAY  ENVIRONMENT  ERRORS 


Erro rs  Dimensions 

I II 


A. 

Salvage  a landing  from  a poor  ap- 

proach that  should  have  been  a 
wave-off 

0.460 

-0.881 

B. 

Raise  the  landing  gear  prematurely  - 

■0.553 

-0.639 

C. 

Accomplish  an  unauthorized  over- 

weight landing 

1.682 

-0.300 

D. 

Shift  hand  to  nose  wheel  steering 

too  soon 

0.420 

0.643 

E. 

Taxi  the  aircraft  into  a snow  bank 

0.020 

-1.009 

F. 

Flare  too  high 

0.135 

0.717 

G. 

Applying  too  much  brake  on  landing 

rollout 

■0.006 

0.676 

H. 

Tap  brake  while  applying  rudder  on 

rollout 

•0.269 

0.626 

I. 

Make  a hard  landing,  "G"  meter 
exceeds  5.2  "G's" 

•0.056 

-0.003 

J. 

Turn  off  runway  too  fast,  blow  tire 

0.242 

-0.163 

K. 

Allow  prop  to  contact  runway  during 

crosswind  landing 

0.581 

-0.596 

L. 

Reversing  too  fast  on  no-flap 

landing,  pitchlocked  prop 

■0.742 

-0.409 

M. 

Over-rotate  on  takeoff 

0.263 

0.707 

N. 

Induce  an  autofeather  by  rapid 

movement  of  P/L 

0.809 

0.278 

0. 

Taxi  off  the  taxiway  at  night 

0.104 

-0.976 

P. 

Overtemp  an  engine  by  rapid  movement 

of  P/L 

0.553 

0.888 

Q. 

Retract  gear  before  flaps  during  a 

wave-off 

0.451 

0.441 

III 

0.860 

0.655 

■0.126 

0.161 

•0.422 

■0.511 

0.084 

0.379 

0.718 

0.075 

0.550 

0.048 

0.419 

0.466 

0.314 

0.324 

0.917 


29 


WEATHER  where  the  decision  to  commit  these  errors  is  not 


usually  made  in  a time  sensitive  environment. 

Dimension  II:  Seriousness.  The  errors  in  this 
dimension  range  from  (0)  MAKE  A WHEELS  UP  PASS  and  (P)  LET 
AIRCRAFT  DESCEND  BELOW  SAFE  ALTITUDE  AT  NIGHT  which  are 
fairly  serious  errors,  to  (L)  CREWMAN  INJURED  DURING  HEAVY 
WEATHER  FLYING  and  (D)  DISCHARGE  HRD  INTO  WRONG  ENGINE  DURING 
TRANSFER  which  are  errors  of  a lesser  seriousness. 

Dimension  III:  Responsibility.  The  errors  in 
this  dimension  range  from  (K)  TAKE  OFF  WITH  DOWNING  DISCREP- 
ANCY and  (Q)  MAKE  A WHEELS  UP  PASS  which  are  the  type  errors 
that  would,  in  the  author's  opinion,  be  solely  the  responsi- 
bility of  the  pilot,  to  (J)  DESCEND  THROUGH  200  FT  IN  DAY- 
TIME MAD  PATTERN  and  (0)  CALL  FOR  THE  WRONG  ENGINE  TO  BE 
FEATHERED,  errors  that  may  be  momentary  oversights,  over- 
reaction or  overcontrolling  and  although  the  pilot  is 
responsible,  he  may  assign  some  of  the  responsibility  to 
other  people  or  other  occurrences  in  the  flying  environment. 

ACCEPTABLE  ERRORS 

Dimension  I:  Attentiveness.  The  errors  in  this 
dimension  range  from  (P)  ALLOW  CABIN  ALTITUDE  TO  EXCEED 
10,000  FEET  and  (A)  FAIL  TO  NOTE  VOR  OFF  FLAG  both  of  which 
require  close  attention  by  the  pilot  not  to  miss,  to  (W) 

TAKE  OFF  WTTH  PT  TOT  COVERS  LEFT  ON  and  ( R)  UNABLE  TO  RATSE 
GEAR  DUE  TO  GEAR  PINS  BEING  LEFT  IN,  both  of  which  are 
easier  to  discover  and  prevent  from  happening. 
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Dimension  II: 


Professionalism.  The  errors  in 


this  dimension  at  first  seemed  to  be  un interpretable , ranging 
from  navigation  errors  at  one  end  to  systems  knowledge  at 
the  other.  In  the  pilots' view,  knowledge  of  aircraft  systems 
is  a sign  of  professionalism  and  while  all  these  errors  are 
acceptable,  the  navigational  errors  are  oversights  that  a 
pilot,  even  though  very  professional# may  make.  The  errors 
then,  range  from  (0)  SET  UP  RADIOS/HSI  WRONG  FOR  CLIMBOUT 
CLEARANCE  and  (Y)  MISREAD  ALTIMETER  to  (J)  ATTEMPT  TO  START 
A DECOUPLED  ENGINE  and  (Q)  NOT  SECURING  ENGINE  START  WHEN 
BLEED  AIR  DID  NOT  RETURN  TO  PRE-START  PRESSURE. 

Dimension  III:  Consciousness.  Although  there  is 
a lack  of  consciousness  in  making  all  these  errors,  the 
author  detects  a greater  degree  of  this  failing  along  this 
dimension.  Ranging  from  (N)  ALLOW  PROP  WASH  TO  CAUSE  DAMAGE 
TO  OTHER  AIRCRAFT  and  (U)  EXCEED  DESIGN  AIRSPEED  FOR  FLAP 
SETTING,  which  seem  to  show  that  the  pilot  was  thinking  of 
something  else  at  the  time,  to  (D)  CHECK  LIST  NOT  COMPLETE 
and  (F)  NOT  RECOGNIZING  A PITCHLOCK  CONDITION,  errors  that 
occur  as  the  pilot  is  dealing  with  that  very  situation. 

RUNWAY  ENVIRONMENT  TECHNIQUE  ERRORS 

Dimension  I:  Deliberateness.  The  errors  in  this 
dimension  range  from  (C)  ACCOMPLISH  AN  UNAUTHORIZED  OVER- 
WEIGHT LANDING  and  (D)  SHIFT  HAND  TO  NOSEWHEEL  STEERING  TOO 
SOON  which  are  deliberate  actions  on  the  part  of  the  pilot. 
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to  (N)  INDUCE  AN  AUTOFEATHER  BY  RAPID  MOVEMENT  OF  P/L  and 
(K)  ALLOW  PROP  TO  CONTACT  RUNWAY  DURING  CROSSWIND  LANDING 
which  are  caused  by  the  pilot  but  have  less  an  element  of 
deliberate  action  on  his  part. 

Dimension  II:  Skill.  The  errors  in  this  dimen- 
sion range  from  (E)  TAXI  THE  AIRCRAFT  INTO  A SNOW  BANK  and 
{O)  TAXI  OFF  THE  TAXIWAY  AT  NIGHT  which  are  errors  that  are 
"headwork"  type  errors  and  may  denote  the  experience  level 
or  lack  of  skill  of  the  pilot,  to  (D)  SHIFT  HAND  TO  NOSE- 
WHEEL  STEERING  TOO  SOON  and  (F)  FLARE  TOO  HIGH  which  are 
motor-skill  type  errors  that  in  the  pilots'  perception  do 
not  denote  as  much  a lack  of  skill  as  "headwork"  errors. 

Dimension  III:  Effect  to  Cause.  The  errors  in 
this  dimension  range  from  (F)  FLARE  TOO  HIGH  and  (I)  MAKE 
A HARD  LANDING  "G"  METER  EXCEEDS  5.2  "G's"  which  are, in  a 
way, effects  of  errors,  to  (A)  SALVAGE  A LANDING  FROM  A POOR 
APPROACH  THAT  SHOULD  HAVE  BEEN  A WAVEOFF  and  (B)  RAISE  THE 
LANDING  GEAR  PREMATURELY  which, in  a way, are  causes. 

In  summary,  these  dimensions  may  be  arbitrarily  named 
and  interpreted,  but  still  provide  us  with  areas  for  possible 
study  or  themes  for  training  programs  in  the  future. 
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CHAPTER  IV 


THE  SECOND  FLEET  PILOT  STUDY 

Fifty-two  P-3  pilots  ranging  in  age  from  23  to  43  and 
in  pilot  hours  from  50  to  3700  were  surveyed  at  a second 
major  patrol  squadron  base  in  April  1978.  The  pilots  inter- 
viewed in  this  study  fly  a slightly  different  version  of  the 
P-3  aircraft  than  that  flown  by  the  first  group,  although 
it  is  essentially  the  same  in  terms  of  actual  flying  in  the 
domain  examined  in  this  study.  The  interviews  were  con- 
ducted in  the  same  manner  as  the  first  study  except  that 
additional  data  on  four  attributes  were  gathered  from  each 
pilot  after  the  sorting  and  seriousness  determination  tasks 
were  completed.  The  analysis  of  the  .lttiibuLe  data  is  dis- 
cussed in  Chapter  VII. 

The  clustering  solution  for  the  second  group  of  fleet 
pilots  is  depicted  in  Figure  9.  Slight  differences  from 
the  first  group's  clustering  can  be  detected,  but  the  basic 
clustering  structure  of  Acceptable  Errors,  Unacceptable 
Errors  and  Runway  Environment  Technique  Errors  is  still 
present. 

I.  Unacceptable  Errors.  The  mid-lower  cluster  of 
sixteen  errors  from  CONTINUE  A FLIGHT  WITH  A HAIL  DAMAGED 
AIRCRAFT  to  FAIL  TO  MAINTAIN  SAFE  FLYING  SPEED  appears  to 
be  an  Unacceptable  Error  Cluster.  As  in  the  first  study, 
these  errors  are  killers  and  unacceptable  to  most  pilots. 
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FIGURE  9 

SECOND  FT.EFT  PILOT  STUDY  CLUTTERING  OF  ERRORS 


"Outlyers" 


II.  Acceptable 
Errors  


1 

1 

1 1 

1 — 

, — 

III.  Runway  Environment 
Technique  Errors 

^ r -r 


— FLY  INTO  A KNOWN  THUNDERSTORM  AREA. 

— FLIGHT  SHOULD  NOT  HAVE  BEEN  FLOWN,  WEATHER. 

— TAKE  OFF  WITH  DOWLING  DISCREPANCY. 

— SALVAGE  A LANDING  FROM  A POOR  APPROACH  THAT  SHOUID  HAVE  BEEN  A WAVE-OFF. 

— FAILURE  TO  NOTE  "VOR  OFF"  FLAG. 

— FAILURE  TO  USE  ALL  AVAILABLE  NAVAIDS  TO  DETERMINE  POSITION. 

— SET  UP  RADIOS/HSI  WRONG  FOR  CUMBOOT  CLEARANCE. 

— TAKE  CFF  WITH  FLAPS  NOT  SET  AT  "TAKE-OFF  AND  APPROACH . " 

— TAKE  CFF  WITH  TRIM  TABS  S1.T  IMPROPERLY. 

— CHEEK  LIST  NOT  COMPLETED. 

— RESTART  AN  ENGINE  IN-FLIGHT  WITH  CIRCUIT  BREAKERS  NOT  PROPERLY  EGSET . 

— TAXI  THE  AIRCRAFT  INTO  A SNOW  BANK. 

— TAXI  OFF  THE  TAXIWAY  AT  NIGHT. 

— ALLOW  PROP  WASH  TO  CAUSE  DAMAGE  TO  OTHER  AIRCRAFT. 

— UNABLE  TO  RAISE  GEAR  DUE  TO  GEAR  PINS  BEING  LETT  IN. 

— TAKE  CFF  WITH  PITOT  COVERS  LEFT  ON. 

— INGEST  ENGINE  INTAKE  COVER  DURING  NIGHT  START. 

— FUELING/ACCESS  PANEL  NOT  PROPERLY  SECURED  FOP.  FLIGHT. 

— ALLOW  IMPROPER  FUEL  TRANSFER  PROCEDURES. 

— ALLOW  CABIN  ALTITUDE  TO  EXCEED  10,000  FT. 

— NOT  RECOGNIZING  A PITCHLOCK  CONDITION. 

— SECURE  AN  ENGINE  IN- FLIGHT  PRIOR  TO  DETERMINING  IF  ACTUAL  MALFUNCTION  EXISTS . 

— DISCHARGE  HRD  INTO  WRONG  ENGINE  DURING  TRANSFER. 

— CALL  FOR  WRONG  ENGINE  TO  BE  FEATHERED. 

— ATTEMPT  TO  START  A DECOUPLED  ENGINE. 

— NOT  SECURING  ENGINE  START  WHEN  BLEED  AIR  DID  NOT  RETUTOi  TO  PRE-START  PPES' 

— NOT  INVESTIGATING  CAUSE  OF  "ANTI  ICE"  LIGHT  ILLDMINATICN . 

— IMPROPER  USE  OF  DEICING  EQUIPMENT. 

— CONTINUE  FLIGHT  WITH  HAH  DAMAGED  AIRCRAFT. 

— CREWMAN  INJURED  DURING  HEAVY  WEATHER  FLYING. 

— ALLOW  CREW  ENTRY  INTO  LOAD  CENTER  DURING  FLIGHT. 

— INJURY  RESULTS  TO  CREWMAN  FROM  PIIOT  INDUCED  AIRCRAFT  MANEUVERS . 


ACCOMPLISH  AN  UNAUTHORIZED  OVERWEIGHT  LANDING. 

FLY  BELOW  GCA  MINIMUM.'-  ON  ACTUAL  APPROACH. 

LET  AIRCRAFT  DESCEND  BELCW  SAFE  ALTITUDE  AT  NIGHT. 

DESCENT  THROUGH  200  FT  IN  DAYTIME  MAD  PATTERN. 

DECLARE  A LOW  FUEL  STATE  DUE  TO  HEADWINDS. 

GO  IFR  CN  A VFR  CLEARANCE. 

OCNFUSICN  AS  TO  IFR  ALTITUDE  ASSIGNMENT,  NEAR  MISS. 

MISREAD  ALTIMETER. 

MAKE  A WHEELS  UP  PASS. 

ALLOW  PROr  TO  CONTACT  RUNWAY  DURING  CROSSWIND  LANDING. 

FAIL  TO  MAINTAIN  SAFE  FLYING  SPEED,  ENTER  UNCONTROLLED  FLIGHT. 

ATTEMPT  AN  ABORT  AFTER  REFUSAL  MIEN  ENGINE  FAILS . 

ABORT  TAKEOFF  BEYOND  REFUSAL  SPEED  WHEN  SMOKE  REMOVAL  DOOR  POPS  OPEN. 

RAISE  THE  LANDING  GEAR  PREMATURELY. 

FLARE  TOO  HIGH. 

OVER  ROTATE  ON  TAKEOFF. 

SHIFT  HAND  TO  NOSE  WHEEL  STEERING  TOO  SOON. 

API ’LYING  TOO  HOI  BRAKE  ON  I AIDING  ROT  JOT. 

TAP  BRAKE  WHILE  APPLYING  RUDDER  ON  ROLLOUT. 

EXCEED  DESIGN  AIRSPEED  FOR  FTAP  SETTING. 

RAISING  GEAR  BEFORE  BRAKES  COOL  BLOWING  TIIEIMAL  ITUS. 

- — REVERSING  TOO  FAST  ON  NO  FIAT  LANDING,  PITCHIOCKLD  PROP. 

RETRACT  GEAR  BEFORE  FTAPS  DURING  A WAVF.-OET. 

MAKE  A HARD  LANDING,  "G"  METER  EXCEEDS  5.2  "G’s." 

TURN  CFF  RUNWAY  TOO  FAST,  BLOW  TIRE. 

INDUCE  AN  ALTOFEATHER  BY  RAPID  MOVEMENT  OF  P/L. 

OVEFTEMP  AN  ENGINE  BY  RAPID  MOVEMENT  OF  P/L. 


The  sub-clusters  of  deliberate  errors  and  spur-of-the- 
moment  errors  are  not  as  distinct  in  the  second  study  as 
in  the  first. 


II.  Acceptable  Errors.  The  Acceptable  Error  Cluster 
is  the  mid-upper  cluster  of  twenty-one  errors  from  TAKE  OFF 
WITH  FLAPS  NOT  SET  AT  K TAKE-OFF  AND  APPROACH"  to  IMPROPER 
USE  OF  DEICING  EQUIPMENT.  As  in  the  first  fleet  pilot  study, 
the  sub-clusters  of  inattention  and  systems  knowledge  errors 
were  present. 

III.  Runway  Environment  Technique  Errors.  The  lower 
cluster  of  sixteen  errors  from  ATTEMPT  AN  ABORT  AFTER  REFUSAL 
WHEN  ENGINE  FAILS  to  OVER  TEMP  AN  ENGINE  BY  RAPID  POWER  LEVER 
MOVEMENT  is  the  Runway  Environment  Technique  Error  Cluster. 
Again  the  sub-clusters  are  not  as  distinct  in  this  group  as 
they  were  in  the  first  fleet  pilot  study. 

The  first  two  small  clusters  at  the  top  of  the  clustering 
sequence  are  "outlyers"  and  contain  errors  from  each  of  the 
three  major  clusters  (Acceptable,  Unacceptable  etc.)  of  the 
first  study.  The  occurrence  of  several  major  P-3  accidents 
during  the  period  between  the  two  studies  may  have  influenced 
the  sorting  of  the  second  group  of  pilots;  alternative  hypo- 
theses, however,  involve  differences  resulting  from  geographic 
location,  aircraft  model  differences,  differences  in  deploy- 
ment sites,  command  influence  and  differences  in  antecedent 
training. 
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In  summary,  the  differences  in  the  clusterings  of  the 
two  groups  shows  that,  notwithstanding  the  fact  that  P-3 
pilots  are  a select  group,  highly  trained  in  very  specialized 
work,  they  have  differences  in  the  way  they  array  errors  in 
their  minds.  Customarily,  cognizant  Navy  officials  at  all 
levels  tend  to  think  of  a P-3  pilot  as  "A  P-3  pilot,"  similar 
in  most  respects,  standardized  and  differing  only  in  his 
experience  level  as  measured  by  how  many  flight  hours  he 
has  accumulated.  He  is  treated  accordingly  and  assigned  to 
billets  as  "A  P-3  pilot"  with  other  factors,  such  as  overall 
performance,  determining  which  P-3  pilot  billet  he  occupies. 

In  contrast  to  this  approach,  the  subtle  differences  shown 
in  the  clustering  of  errors  may  suggest  differences 
in  P-3  pilots  that  should  be  taken  into  account,  at  least 
in  terms  of  required  training  and  likely  safety  record  of 
an  individual  pilot. 

The  presence  of  the  basic  structure  of  Acceptable,  Unac- 
ceptable and  Runway  Environment  Technique  Errors  might  indi- 
cate, for  instance,  that  some  errors  are  loosely  structured 
in  pilots'  minds  and  that  if  the  Navy  is  striving  for  a 
standardized  P-3  pilot,  some  formal  training  in  error 
structuring  which  would  strengthen  these  clusters  in  a 
desirable  fashion  might  be  indicated. 

Multidimensional  Scaling.  Each  of  the  major  clusters 
was  separately  scaled  to  attempt  to  identify  the  dimensions 
of  the  action  space.  Figures  10,  11,  and  12  with  accompanying 
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RESPONSIBILITY  (HI) 


among  tht  16  Unocetptobte 


3^ 


TABLE  VIII 


UNACCEPTABLE  ERRORS --SECOND  FLEET  PILOT  STUDY 


A. 

Errors 

Fly  below  GCA  minimums  on  actual 
approach 

I 

0.575 

Dimens  ions 

II 

-0.123 

B. 

Accomplish  an  unauthorized  over- 
weight landing 

-0.712 

0 .227 

C. 

Injury  results  to  crewman  from  pilot- 
induced  aircraft  maneuvers 

-0 . 750 

-0.164 

D. 

Decouple  the  prop  due  to  excessive 
airspeed  on  restart 

-0.456 

-0.846 

E. 

Fail  to  maintain  safe  flying  speed, 
enter  uncontrolled  flight 

-0.066 

-0 .563 

F. 

Allow  crew  entry  into  load  center 
during  flight 

-0.822 

0 .322 

G. 

Allow  prop  to  contact  runway  during 
crosswind  landing 

-0.608 

-0 . 747 

H. 

Descent  through  200  feet  in  daytime 

MAD  pattern 

0.144 

-0 .353 

I. 

Declare  a 16w  fuel  state  due  to 
headwinds 

0.725 

1.002 

J. 

Crewman  injured  during  heavy -weather 
flying 

-0.829 

0 .690 

K. 

Continue  flight  with  hail-damaged 
aircraft 

-0.593 

0 .613 

L. 

Confusion  as  to  IFR  altitude 
assignment,  near  miss 

0.927 

0.135 

M. 

Let  aircraft  descend  below  safe 
altitude  at  night 

0.515 

-0.192 

N. 

Make  a wheels -up  pass 

0.470 

-0.938 

0. 

Misread  altimeter 

1.266 

-0.029 

P. 

Go  IFR  on  a VFR  clearance 

0.215 

0 .964 

III 

0.532 

0.797 

0.123 

0.883 

0.117 

0.46  3 

0 .192 

0.591 

0.477 

0 . 368 

0.176 

0.177 

0.195 

0.124 

0.535 

0.197 
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TABLE  IX 


ACCEPTABLE  ERRORS — SECOND  FLEET  PILOT  STUDY 


Errors 


Dimensions 


A. 

B. 

C. 

D. 

E. 

F. 

G. 

H. 

I . 

J. 

K. 

L. 

M. 

N . 

O. 

P. 

Q. 

R. 

S. 

T. 

U. 


Take  off  with  flaps  not  set  at  "take- 

I 

II 

II 

off  and  app  ro  ach " " 

Allow  improper  fuel  transfer  pro- 

-0.603 

0.273 

-0 . 371 

cedures 

0.503 

-0.773 

0.299 

Check  list  not  completed 

-0.333 

0 .202 

-0.524 

Take  off  with  trim  tabs  set  improperly 

-0 .832 

-0.113 

-0.101 

Not  recognizing  a pitchlock  condition 
Discharge  HRD  into  wrong  engine 

0.876 

0.201 

0 . 304 

during  transfer 

Not  investigating  cause  of  "anti-ice" 

0 .675 

0.378 

0.154 

light  illumination 

Secure  an  engine  in-flight  prior  to 
determining  if  actual  malfunction 

0.808 

-0.407 

-0.337 

exists 

1 . 154 

0 . 190 

-0.092 

Attempt  to  start  a decoupled  engine 
Restart  an  engine  in-flight  with 

0 .791 

0.395 

-0 . 392 

circuit  breakers  not  properly  reset 

-0.023 

-0.295 

-0 . 357 

Improper  use  of  de-icing  equipment 

0.844 

-0.478 

0.574 

Taxi  aircraft  into  a snow  bank 

Allow  prop  wash  to  cause  damage  to 

-0 . 786 

0.793 

0.587 

other  aircraft 

Allow  cabin  altitude  to  exceed 

-0  .911 

0.178 

0.866 

10 ,000  feet 

Not  securing  engine  start  when  bleed 
air  did  not  return  to  pre-start 

0.368 

-0.861 

0 .919 

pressure 

Unable  to  raise  gear  due  to  gear  pins 

0.460 

0.485 

-0.743 

being  left  in 

Fuelinq/access  panel  not  properly 

-0  .664 

-0 .358 

-0.491 

secured  for  flight 

Ingest  engine  intake  cover  during 

-0.738 

-0.733 

-0.263 

night  start 

-0.772 

-0.263 

-0.257 

Taxi  off  the  taxiway  at  night 

-0.755 

0.739 

0.711 

Take  off  with  pitot  covers  left  on 

Call  for  wrong  engine  to  be 

-0.734 

-0 . 316 

-0.420 

feathered 

0.672 

0.764 

-0.065 
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Figure  12 


Three-dimensionol  representation  of  interpoint  distonces  among 
the  16  Runway  Environment  Technique  Errors,  Second  Fleet 
Pilot  Study. 
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TABLE  X 


RUNWAY  ENVIRONMENT  TECHNIQUE  ERRORS — SECOND  FLEET  PILOT  STUDY 
Errors  Dimensions 

I II  III 

A.  Attempt  an  abort  after  refusal  when 


engine  fails 

1.468 

0.050 

0 .069 

B. 

Raise  the  landing  gear  prematurely 

0 .632 

-0.472 

0.702 

C. 

Abort  takeoff  beyond  refusal  speed 
when  smoke  removal  door  pops  open 

1.382 

0 .252 

0 .085 

D. 

Shift  hand  to  nose  wheel  steering 
too  soon 

-0.546 

0.058 

0.196 

E. 

Flare  too  high 

-0.627 

0 .708 

0.119 

F. 

Applying  too  much  brake  on  landing 
rollout 

-0.494 

0.318 

-0.261 

G. 

Tap  brake  while  applying  rudder  on 
rollout 

-0 .640 

0.266 

-0.281 

H. 

Make  a hard  landing,  "G"  meter  ex- 
ceeds 5.2  "g's" 

-0.234 

0.477 

-0.202 

I. 

Turn  off  runway  too  fast,  blow  tire 

0.067 

0 .235 

-0 .611 

J. 

Reversing  too  fast  on  no-flap 
landing,  pitchlocked  prop 

0.556 

-0.027 

-0.531 

K. 

Over-rotate  on  takeoff 

-0.412 

0.515 

0 . 302 

L. 

Induce  an  autofeather  by  rapid  move- 
ment of  P/L 

0.079 

-0.881 

-0.692 

M. 

Exceed  design  airspeed  for  flap  setting 

-1.262 

-0.525 

0 .631 

N. 

Raising  gear  before  brakes  cool  blow- 
ing thermal  plugs 

0.084 

-1.047 

0.522 

0. 

Overtemp  an  engine  by  rapid  movement 
of  P/L 

-0.416 

-0 .607 

-0.575 

P. 

Retract  gear  before  flaps  during 
a wave -off 

0.363 

0 .679 

0.527 
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Tables  VI II,  IX  and  X represent  the  multidimensional 
scaling  solution  for  each  separate  cluster.  No  attempt 
was  made  to  scale  the  outlyers  since  there  were  too  few 
errors  to  obtain  significantly  stressed  dimensions.  The 
dimensions  of  the  major  clusters  appeared  to  be  the  same 
as  in  the  first  study  and  will  not  be  discussed  here. 
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CHAPTER  V 


THE  COMBINED  RESULTS 

After  the  Second  Fleet  pilot  study  data  were  analyzed, 
they  were  combined  with  the  data  from  the  first  study.  The 
resulting  data  base  for  all  103  pilots  was  subjected  to  the 
hierarchical  clustering  program.  Although  slightly  different 
from  each  of  the  individual  studies,  the  combined  cluster 
still  retains  the  basic  underlying  structure  of  each  of  its 
component  parts.  Figure  13  is  the  combined  clustering 
solution  for  all  103  pilots. 

I.  Acceptable  Errors.  The  mid- lower  cluster  of 
errors  listed  from  TAKE  OFF  WITH  FLAPS  NOT  SET  AT  "TAKEOFF 
AND  APPROACH"  to  NOT  SECURING  ENGINE  START  WHEN  BLEED  AIR 
DID  NOT  RETURN  TO  PRE-START  PRESSURE  is  essentially  the 
Acceptable  Error  Cluster  of  the  past  two  studies.  The  first 
eight  errors  form  a sub-cluster  of  check-list  or  preflight 
errors,  and  the  next  ten  errors  form  a sub-cluster  of  air- 
craft systems  knowledge  errors.  In  all,  these  errors  are 
inattention  or  oversight  errors  that  display  a lapse,  for- 
getfulness or  a kind  of  personal  shortcoming,  and  may  be 
said  to  denote  a lack  of  professionalism  on  the  part  of 
the  pilot. 

II.  Unacceptable  Errors.  The  uppermost  cluster  of 
nine  errors  listed  from  FLY  INTO  A KNOWN  THUNDERSTORM  AREA 
to  ACCOMPLISH  AN  UNAUTHORIZED  OVERWEIGHT  LANDING  is  the 
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FIGURE  13 


103  PILOTS  COMBINED  CLUSTERING 


FLY  INK)  A KNCWJ  THJNDEBSTOW  AEEA. 

FLIGHT  SHOULD  NOT  HAVE  BEEN  FLOWN,  WEATHER. 

CONTINUE  FLIGHT  WITH  HAIL  DAMAGE)  AIRCRAFT. 

ALLOW  CREW  ENTRY  INTO  LOAD  CENTER  CURING  FLIGHT. 

TAKE  OFE'  WITH  DCMIINS  DISCREPANCY. 

INJURY  RESULTS  TO  CHEVWAN  HtH  1 1U/I  INDUC1D  AIRCRAFT  ’IAN ELVERS . 

CREWMAN  INJURED  LURING  HI  ALT  WEATHER  FI.YING. 

SALVAGE  A LANDING  FTCM  A iOOR  AR, 'ROACH  THAT  SIUJLD  HAVE.  BEEN  A WAVE-CTT. 
ACCOMPLISH  AN  UNAUTHORIZED  OVEEWLIGlfT  LANDING. 

FAILURE:  TO  NOTE  "VOR  CFF"  FLAG. 

FAILURE  TO  USE  ALL  AVAILAIli-E  NAVAIDS  TO  DETLFWIN1.  HjSITICN. 

SE.T  UP  RADIOS/HSI  WRJJG  FOR  a.IMBOUT  CLEARANCE. 

FXY  BELOW  GCA  MINIUMS  CN  ACTUAL  APPROACH. 

LET  AIRCRAFT  DESCEND  EELOW  SAID  ALTITUDE  AT  NIGHT. 

DESCENT  THROUGH  200  FT  IN  DA', TIME  MAD  PATTEWJ. 

ALLOW  CABIN  ALTITUDE  TO  EXCEED  10,000  FT. 

DECLARE  A LOW  FUEL  STATE  CUE  TO  HEADWINDS. 

GO  IFR  CN  A VFP  CLEARANCE. 

CONFUSION  AS  TO  IFR  ALTITUDE  ASSIGNMENT,  NEAR  MISS. 

MISREAD  ALTIMETER. 

TAKE  OFF  WITH  FIAPS  NOT  SET  AT  "TAKE-OFF  AND  APPROACH." 

TAKE  CFF  WITH  TRIM  TABS  SET  IMPROPERLY. 

CHEEK  LIST  NOT  COMPLETED. 

RESTART  AN  ENGINE  IN-FLIGHT  WITH  CIRCUIT  BREAKERS  NOT  PROPERLY  RESET. 

UNABLE  TO  RAISE  GEAR  DUE  TO  GEAR  PINS  BEING  LEFT  IN. 

TAKE  CFF  WITH  PITOT  COVERS  LEFT  ON. 

INGEST  ENGINE  INTAKE  CCVER  DURING  NIGHT  START. 

FUELING/ACCESS  PANEL  NOT  PROPERLY  SECURED  FOR  FLIGHT. 

ALLOW  IMPROPER  FUEL  TRANSFER  PROCEDURES. 

IMPROPER  USE  OF  DEICING  EQUIPMENT . 

NOT  INVESTIGATING  CAUSE  OF  "ANTI  ICE"  LIGHT  ILUMINAT1CN. 

NOT  REOOCKIZING  A PITCHL0CK  CONDITION. 

DECOUPLE  TOE  PROP  DUE  TO  EXCESSIVE  AIRSPEED  ON  RESTART. 

DISCHARGE  HRD  INTO  WRONG  ENGINE  DURING  TRANSFER. 

CALL  FOR  WICNG  ENGINE  TO  BE  FEATHERED. 

SECURE  AN  ENGINE  IN-FLIQTT  PRIOR  TO  DETERMINING  IF  ACTUAL  MAUUNCTICN  HOSTS. 
ATTEMPT  TO  START  A DECOUPLED  ENGINE. 

NOT  SECURING  ENGINE  START  WHEN  BLEED  AIR  DID  NOT  KETO»v  TO  PRE-START  PRESSIWE. 
ATTEMPT  AN  ABORT  AFTER  REFUSAL  WHEN  ENGINE  FAILS. 

ABORT  TAKEOFF  BEYCND  REFUSAL  SPEED  WHEN  SMOKE  REMOVAL  DOOR  POPS  OPEN. 

RAISE:  THE  LANDING  GEAR  PREMATURELY. 

TAXI  THE  AIRCRAFT  INTO  A SNOW  BANK. 

TAXI  OFF  THE  TAXIVAY  AT  NIGHT. 

TURN  OFF  RUNWAY  TOO  FAST,  BLOW  TIRE. 

ALLOW  PROP  WASH  TO  CAUSE  DAMAGE  TO  OTHER  AIRCRAFT. 

FAIL  TO  MAINTAIN  SAFE  FLYING  SPEED,  INTER  UNCONTROLLED  FLIGHT. 

ALLOW  PROP  TO  CONTACT  RUNWAY  DURING  CROSSWIND  LANDING. 

MAKE  A VHEELS  UP  PASS. 

SHIFT  HAND  TO  NOSE  WHEEL  STEERING  TOO  SOON. 

APPLYING  TOO  MUCH  BRAKE  CN  LANDING  ROLLOUT. 

TAP  BRAKE  WHILE  APPLYING  RUDDER  ON  ROLLOUT. 

FLARE  TOO  HIGH. 

CVER  ROTATE  ON  TAKEOFF. 

MAKE  A HARD  LANDING,  "G"  METER  EXCEEDS  5.2  "G’s." 

REVERSING  TOO  FAST  CN  NO  FLAP  LANDING,  PTTC3 HOCKED  PROP. 

R17TRACT  GEAR  BEFORE  FLAPS  DURING  A WAVE-OFF. 

INDUCE  AN  ALTOFEATHER  BY  RAPID  MOVEMENT  CF  P/L. 

CVERTEMP  AN  ENGINE  BY  RAPID  MOVEMENT  OF  P/L. 

EXCEED  DESIGN  AIRSPEED  TOR  FLAP  SETTING. 

RAISING  GEAR  BEFORE  BRAKES  COOL  BLOWING  THERMAL  PLUGS. 
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Unacceptable  Error  Cluster.  It  is  still  much  an  outlyer 
from  the  other  major  clusters  showing  that  these  errors  are 
those  that  pilots  find  the  hardest  to  associate  with  other 
errors.  Stated  somewhat  differently,  they  seem  to  be  a 
special  class  of  errors.  There  is  a deliberateness  in  most 
of  these  errors.  This  may  be  the  factor  that  sets  them 
apart  from  the  other  errors.  Instead  of  being  a blunder, 
a slip  or  an  inadvertant  mistake,  these  errors  seem  to  be 
conscious,  intentional,  made-by-decision-errors. 

The  mid-upper  cluster  of  eleven  errors  listed  from 
FAILURE  TO  NOTE  VOR  OFF  FLAG  to  MISREAD  ALTIMETER  appears 
to  still  be  another  unacceptable  grouping  with  a slant 
towards  weather  or  Instrument  Flying  Rules  (IFR)  flying. 

Most  errors  involve  dial  or  instrument  monitoring  and  most 
were  situated  in  the  Unacceptable  Error  Clusters  in  the  two 
prior  studies.  Also  this  cluster  does  not  join  the  other 
major  clusters  until  the  8th  level  which  is  very  similar  to 
the  position  in  first  fleet  pilot  study. 

III.  Runway  Environment  Technique  Errors.  The  lower 
cluster  of  twenty-two  errors  listed  from  ATTEMPT  AN  ABORT 
AFTER  REFUSAL  WHEN  ENGINE  FAILS  to  RAISING  GEAR  BEFORE  BRAKES 
COOL,  BLOWING  THERMAL  PLUGS  is  the  Runway  Environment  Tech- 
nique Cluster.  These  errors  display  a lack  of  experience 
and  are  coordination  or  motor  skill  errors.  These  are  errors 
that  involve  actual  control  of  the  aircraft  and,  as  described 
below,  point  out  the  conception  that  P-3  pilots  may  have  of 
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differences  between  an  aviator  and  a pilot.  These  are  the 
"stick  and  rudder”  pilot  errors,  as  differentiated  by  P-3 
pilots  from  the  aviator  errors  in  the  Acceptable  Error 
Cluster. 

It  is  the  author's  opinion  that  in  the  subculture  of 
P-3  pilots  there  is  a perceived  difference  between  a "pilot" 
and  an  "aviator"  (author's  terms).  The  "pilot"  may  be  an 
accomplished  "stick  and  rudder  man,"  who  is  a precision 
flyer  in  terms  of  physically  handling  the  aircraft,  while 
at  the  same  time  he  can  be  a poor  aviator--sloppy  in  his 
attention  to  detail  and  shallow  in  his  knowledge  of  aircraft 
systems.  On  the  other  hand,  the  "aviator"  might  not  be  as 
skilled  in  precision  flying  but  is  more  expert  in  administra- 
tion, instructing,  leadership,  and  judgment.  For  instance, 
a good  "pilot"  may  always  land  the  aircraft  precisely  on 
speed  at  the  touchdown  point,  but  he  may  be  prone  to  over- 
look an  item  on  the  checklist,  while  an  "aviator"  might  not 
be  as  precise  in  flying  the  aircraft  but  would  be  professional 
in  his  supervision  of  the  crew,  and  unlikely  to  miss  an  item 
on  the  preflight. 

The  desired  flying  officer  from  a safety  point  of  view 
is  an  officer  who  has  the  good  points  of  both  the  "pilot" 
and  the  "aviator,"  and  certainly  the  P-3  aviation  community 
has  some  of  these.  However,  the  segregation  of  the  Acceptable 
Errors  when  compared  to  the  Runway  Environment  Technique 
Errors  seems  to  bear  a relationship  to  the  "pilot/aviator" 
conception. 
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In  all,  the  combined  clustering  represents  a smoothed- 
out  or  averaged  clustering  when  compared  to  its  components. 
It  tells  us  that  P-3  pilots,  although  not  formally  trained 


in  error  structuring,  do  have  a basic  cognitive  mapping 
of  errors.  Something  in  their  cultural  pattern  tells  them 
to  structure  the  errors  along  three  groupings:  Acceptable, 
Unacceptable  and  Runway  Environment  Technique  areas.  More 
sophisticated  research  should,  however,  define  more  suc- 
cinctly the  nature  and  limits  of  these  groupings.  The  com- 
bined clustering  also  tells  us  that  there  are  certain  errors 
that  P-3  pilots  find  difficulty  in  grouping  within  these  cate- 
gories because  they  appear  to  be  unacceptable  while  at  the 
same  time  showing  a certain  level  of  wilful  deliberateness. 
Without  question,  further  study  of  this  special  group  of 
errors  is  warranted. 

Multidimensional  Scaling.  Each  of  the  major  clusters 
was  separately  scaled  to  attempt  to  identify  the  dimensions 
of  the  action  space.  Figures  14,  15,  16  and  17,  with  accom- 
panying Tables  XI,  XII,  XIII,  abd  XIV,  represent  the  multi- 
dimensional solutions  for  each  separate  cluster.  The  two- 
dimensional  solutions  for  the  Deliberate  and  IFR  clusters 
were  uninterpretable.  Although  partially  changed  by  errors 
shifting  between  clusters,  the  three-dimensional  solutions 
for  the  Acceptable  and  Runway  Environment  Technique  clusters 
still  retained  dimensions  found  in  the  first  two  studies. 


48 


IDIMENSIOI 


•a O— 2blZ«ft  — OZ  «M  ► 


49 


Two-dimensional  representation  of  interpoint  distonces  among  the 
9 Unacceptable,  Deliberate  Errors,  10 3 Pilots  Combined. 


TABLE  XI 


UNACCEPTABLE  DELIBERATE  ERRORS --10 3 PILOTS  COMBINED 

Errors  Dimensions 


A. 

Fly  into  a known  thunderstorm  area 

I 

-0.156 

II 

0.684 

B. 

Salvage  a landing  from  a poor  ap- 
proach that  should  have  been  a 
wave -of f 

1.619 

-0.087 

C. 

Flight  should  not  have  been  flown, 
weather 

0.067 

0 .677 

D. 

Accomplish  an  unauthorized  overweight 
landing 

0.838 

-0 .086 

E . 

Injury  results  to  crewman  from  pilot- 
induced  aircraft  maneuvers 

-0.834 

-0 . 129 

F. 

Allow  crew  entry  into  load  center 
during  flight 

-0.559 

0 . 126 

G. 

Take  off  with  downing  discrepancy 

0 .451 

0.379 

H . 

Crewman  injured  during  heavy -weather 
flying 

-1.277 

-0.696 

I. 

Continue  flight  with  hail-damaged 
aircraft 

-0.148 

0.112 
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Figure  15 


Two-dimensional  representation  of  interpoint  distances  among  the 
II  Unacceptable,  IFR  Errors,  103  Pilots  Combined. 


TABLE  XII 


A. 

IFR  ERRORS--10  3 PILOTS  COMBINED 

Errors 

Attempt  to  start  a decoupled  engine 

I 

1.071 

II 

0 .075 

B. 

Fly  below  GCA  minimum  on  actual  approach 

-0 .158 

-0 .002 

C. 

Failure  to  use  all  available  navaids 
to  determine  position 

0.426 

0.614 

D. 

Set  up  radios/HSI  wrong  for  climbout 
clearance 

0.377 

-0.041 

E. 

Allow  cabin  altitude  to  exceed 

10,000  feet 

1.831 

-0 .370 

F. 

Descent  through  200  feed  in  day  time 

MAD  pattern 

-0 .920 

-0.792 

G. 

Declare  a low  fuel  state  due  to  head- 
winds 

-0.522 

1.045 

H. 

Confusion  as  to  IFR  altitude  assign- 
ment, near  miss 

-0 .396 

-0 .112 

I . 

Let  aircraft  descend  below  safe 
altitude  at  night 

-0.706 

-0.428 

J. 

Misread  altimeter 

0.167 

-0.528 

K. 

Go  IFR  on  a VFR  clearance 

-0.170 

0.539 
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TABLE  XIII 


ACCEPTABLE  INATTENTION  ERRORS — 10  3 PILOTS  COMBINED 


A. 

Behavior 

Take  off  with  flaps  not  set  at  "take- 
off and  approach" 

I 

0.772 

Dimensions 

II 

-0.574 

III 

-0.118 

B. 

Allow  improper  fuel  transfer  pro- 
cedures 

-0.550 

0 .689 

-0  .668 

C. 

Check  list  not  completed 

0.620 

-0.407 

-0 .631 

D. 

Take  off  with  trim  tabs  set  im- 
properly 

1.001 

0.072 

-0.340 

E. 

Not  recognizing  a pitchlock  condition 

-0.825 

-0 .384 

-0.087 

F. 

Discharge  HRD  into  wrong  engine 
during  transfer 

-0.532 

-0.194 

-0.351 

G. 

Not  investigating  cause  of  "anti 
ice"  light  illumination 

-0.463 

0.787 

0.376 

H. 

Secure  an  engine  in-flight  prior  to 
determine  if  actual  malfunction 
exists 

-0.949 

0.000 

-0.058 

I. 

Attempt  to  start  a decoupled  engine 

-0.997 

0 .050 

0.488 

J. 

Decouple  the  prop  due  to  excessive 
airspeed  on  restart 

-0.483 

-0.786 

0.355 

K. 

Restart  an  engine  in-flight  with 
circuit  breakers  not  properly 
reset 

0.138 

0.149 

0.045 

L. 

Improper  use  of  de-icing  equipment 

-0.823 

0 .836 

-0 .364 

M. 

Not  securing  engine  start  when  bleed 
air  did  not  return  to  pre-start 
pressure 

-0.478 

-0.127 

0.791 

N. 

Unable  to  raise  gear  due  to  gear 
pins  being  left  in 

1.040 

0.075 

0.157 

0. 

Fueling/access  panel  not  properly 
secured  for  flight 

1.012 

0.507 

0.308 

P. 

Ingest  engine  intake  cover  during 
night  start 

1.097 

0.200 

0.179 

Q. 

Take  off  with  pitot  covers  left  on 

1.027 

-0.079 

0.199 

R. 

Call  for  wrong  engine  to  be 

-0.279 

feathe  red 

-0.607 

-0.815 

54 


TABLE  XIV 


RUNWAY  ENVIRONMENT  TECHNIQUE  ERRORS — 103 .PILOTS  COMBINED 


A . 

Errors 

Attempt  an  abort  after  refusal  when 
engine  fails 

I 

0.935 

Dimensions 

II 

-0 . 767 

III 

-0 . 307 

B . 

Raise  the  landing  gear  prematurely 

0.242 

-0 .684 

-0.479 

C. 

Abort  takeoff  beyond  refusal  speed 
when  smoke  removal  door  pops  open 

0.810 

-0.709 

-0.307 

D. 

Shift  hand  to  nose  wheel  steering 
too  soon 

-0  .905 

-0.065 

0.048 

E. 

Taxi  the  aircraft  into  a snow  bank 

0 .719 

0.824 

0.186 

F. 

Fail  to  maintain  safe  flying  speed, 
enter  uncontrolled  flight 

1.121 

-0.258 

0.154 

G. 

Allow  prop  wash  to  cause  damage  to 
other  aircraft 

0.519 

1.226 

-0.589 

H. 

Flare  too  high 

-0.781 

0.003 

0 . 152 

I. 

Applying  too  much  brake  on  landing 
rollout 

-0.781 

0.003 

L .152 

J. 

Tap  brake  while  applying  rudder  on 
rollout 

- J .670 

-0.010 

0.321 

K. 

Make  a hard  landing,  "G"  meter  ex- 
ceeds 5.2  "G's" 

-0.157 

-0 .062 

0.550 

L. 

Turn  off  runway  too  fast,  blow  tire 

-0  .071 

0.355 

0 . 164 

M. 

Allow  prop  to  contact  runway  during 
crosswind  landing 

0.532 

-0.267 

0 .419 

N. 

Reversing  too  fast  on  no-flap 
landing,  pitchlocked  prop 

0 . 182 

-0.223 

-0.202 

0. 

Over-rotate  on  takeoff 

-0.640 

-0 . 342 

0.504 

P. 

Induce  an  autofeather  by  rapid 
movement  of  P/L 

-0 .364 

-0 .239 

-0.79  8 

Q. 

Exceed  design  airspeed  for  flap 
setting 

-0.853 

0.842 

0.149 

R. 

Taxi  off  the  taxiway  at  night 

0.574 

0.798 

0 .087 

S. 

Raising  gear  before  braxes  cool 
blowing  thermal  plugs 

-0.143 

0.402 

-0.856 

T. 

Overtemp  an  engine  by  rapid  move- 
ment of  P/L 

-0.947 

0 .078 

-0.525 

U. 

Make  a wheels-up  pass 

1.277 

0 .077 

0.790 

V. 

Retract  gear  before  flaps  during  a 
wave -off 

-0 .635 

-0 .802 

-0  .034 
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CHAPTER  VI 


SERIOUSNESS 


As  previously  described,  each  group  of  pilots  was  asked 
to  sort  the  sixty  errors  into  seven  slots  in  a box,  from 
"most  serious"  to  "least  serious."  Average  rankings  (means) 
for  the  seriousness  of  the  errors  were  computed  for  the  first 
group  of  pilots,  the  second  group  of  pilots  and  an  aggregate 
of  all  103  pilots  combined.  A discriminant  analysis  program 
was  run  between  the  first  group  of  51  pilots  and  the  second 
group  of  52  pilots.  The  results  of  this  analysis  showed 
that  the  second  group  of  pilots  assigned  more  seriousness 

to  the  errors  than  did  the  first  group.  Group  2 assigned 

I 

a higher  mean  seriousness  than  Group  1 to  49  of  the  sixty 
errors,  while  Group  1 had  higher  means  than  Group  2 for 
only  eleven  errors.  More  seriousness  being  attached  to 
errors  by  Group  2 could  be  the  result  of  the  intervening 
accidents  previously  mentioned  but  could  also  result  from 
differences  in  safety  programs  at  the  two  bases  and/or 
other  stimuli. 

Group  membership  (location  1 or  location  2),  based  on 
the  seriousness  ranking  of  the  errors,  could  be  predicted 
with  77.67%  accuracy.  As  the  following  table  illustrates, 
some  of  the  pilots  in  Group  1 (11,  or  21.6%)  ranked  the  errors 
in  a manner  similar  to  the  members  of  Group  2,  and  some  of 
the  pilots  in  Group  2 (12,  or  23.1%)  ranked  the  errors  in  a 
manner  similar  to  that  of  Group  1: 
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TABLE  XV 


GROUP  CLASSIFICATION  BASED  ON  LOCATION  BY 
DISCRIMINANT  ANALYSIS 

Respondent's  Sorting  Respondent's  Sorting 

Correctly  Predicted  Did  Not  Predict 

His  Location  (HIT)  His  Location  (MISS) 


Patrol  Base 
Location  1 
( N = 5 1 ) 

40 

(78.4%) 

11 

(21.6%) 

Patrol  Base 

40 

12 

Location  2 

(76.9%) 

(23.1%) 

(N=52) 

Percent  of  "grouped"  cases  correctly  classified:  77.67% 

Time  constraints  would  not  allow  for  identification  of 
those  cases  that  did,  or  did  not  classify  properly.  Certainly 
an  area  of  fertile  ground  for  future  study  would  be  to  learn 
if  the  majority  of  cases  not  correctly  classified  were  younger 
or  older  pilots,  or  pilots  with  low  or  high  flight  hour  accu- 
mulation . 

When  queried,  the  computer  identified  the  ten  errors  that 
discriminated  best  between  the  two  groups.  Table  XVI  shows 
the  ten  most  d i nori minat ing  errors,  and  the  direction  of  the 
seriousness  assigned  by  the  two  groups. 


TABLE  XVI 


Ton  Most  (>i  sor  iminat  ing  Knocs  tor 


Group  Classification 

n Di 

root  ion 

DISCRIMINANT  ERROR 

Location  1 

Location  2 

ACCOMPLISH  AN  UNAUTHORIZED  OVER- 
WEIGHT LANDING 

less 

serious 

more 

serious 

TAKEOFF  WITH  A DOWNING  DISCREP- 
ANCY 

less 

serious 

more 

serious 

FAILURE  TO  USE  ALL  AVAILABLE  NAV 
AIDS  TO  DETERMINE  POSITION 

more 

serious 

less 

serious 

TAP  BRAKE  WHILE  APPLYING  RUDDER 

ON  ROLLOUT 

less 

serious 

more 

serious 

APPLYING  TOO  MUCH  BRAKE  ON 

LANDING  ROLLOUT 

less 

serious 

more 

serious 

NOT  SECURING  ENGINE  START  WHEN 
BLEED  AIR  DID  NOT  RETURN  TO 
PRESTART  PRESSURE 

less 

serious 

more 

serious 

REVERSING  TOO  FAST  ON  NO  FLAP 
LANDING,  PITCHLOCKED  PROP 

less 

serious 

more 

serious 

SHIFT  HAND  TO  NOSEWHEEL  STEERING 
TOO  SOON 

less 

serious 

more 

serious 

OVER  ROTATE  ON  TAKEOFF 

less 

serious 

more 

serious 

ALLOW  CREW  ENTRY  INTO  LOAD 

more 

serious 

less 

serious 

CENTER  DURING  FLIGHT 

Again  seriousness  ranking  differences  could  have  been  affected 
by  the  accidents  occurring  in  the  interval  between  surveys, 
but  the  author  believes  that  cultural  variations  resulting 
from  command  influence,  geographic  location,  aircraft  model, 
etc.,  also  had  an  impact  upon  the  group  rankings.  Two  facts 
support  this  belief.  First,  the  most  effective  discriminator 
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between  the  two  groups  is  ACCOMPLISH  AN  UNAUTHORIZED  OVER- 
WEIGHT LANDING.  One  of  the  slight  differences  between  air- 
craft models  flown  by  the  two  groups  is  in  the  landing  gear 
configuration,  and  thus  the  consequences  for  making  an 
overweight  landing  are  not  the  same  for  the  group  operating 
one  model  as  they  are  for  the  other. 

Second,  to  point  out  the  effect  of  an  accident  on  the 
seriousness  ranking  of  a subculture,  the  third  most  discrim- 
inant error  (and  one  of  the  two  ranked  as  more  serious  by 
the  first  group)  is  FAILURE  TO  USE  ALL  AVAILABLE  NAV  AIDS 
TO  DETERMINE  POSITION.  The  survey  of  the  first  group  of 
pilots  was  made  less  than  one  month  after  an  aircraft  and 
crew  was  lost  under  circumstances  that  pointed  to  the 
commission  of  this  type  error.  These  two  associations  point 
out  that  there  is  ethnographic  import  to  the  seriousness 
ranking,  and  whatever  the  stimulus  for  the  differences,  fur- 
ther and  more  sophisticated  study  of  these  differences  should 
bear  fruitful  results. 

A second  discriminant  analysis  program  was  conducted 
for  all  103  pilots,  tasking  the  computer  to  search  for  dif- 
ferences in  seriousness  ranking  of  pilots  with  low  P-3  flight 
hours  (40  - 799  hrs.),  medium  P-3  flight  hours  (800  - 1499 
hrs.),  and  high  P-3  flight  hours  (more  than  1500  hrs.).  This 
was  an  attempt  to  determine  how  attitudes  toward  seriousness 
of  errors  change  as  a pilot  gains  in  experience  and  accumu- 
lates flight  hours.  Table  XV I 1 below  shows  the  results  of 
group  class i f icati on  by  flight  hour  accumulation. 
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TABLE  XVII 


GROUP  CLASSIFICATION  BASED  ON  FLIGHT  HOURS 
BY  DISCRIMINANT  ANALYSIS 

Respondent's  Sorting  Respondent's  Sorting 

Correctly  Predicted  Did  Not  Predict  His 

His  Flight  Hour  Grp.  Grp. 

(HIT)  (MISS) 


Low  Fit  Hr 
Pilot 
(N  44) 

30 

(68.2%) 

14 

(31.8%) 

Med  Fit  Hr 
Pilot 

21 

11 

(N  32) 

(65.6%) 

(34.4%) 

High  Fit  Hr 

Pi  lot 

16 

11 

(N  27) 

(59.3%) 

(40.7%) 

Percent  of  "grouped"  cases  correctly  classified:  65.05% 


The  MISSES  in  Tables  XV  and  XVII  above  represent  an 
interesting  group  of  pilots.  If  a pilot's  ranking  of  serious- 
ness causes  him  to  be  misclassif ied  he  may  be  in  a subculture 
of  pilots  who,  although  they  have  a high  number  of  flight 
hours,  continue  to  view  seriousness  in  the  same  way  as  the  low 
flight  hour  group.  Without  stating  which  group  has  the 
optimum  view  of  seriousness,  the  pilots  in  the  group  by  virtue 
of  their  experience  that  do  not  conform  to  the  group  "norms" 
might  bear  special  study. 

The  ten  errors  that  most  discriminated  among  the  three 
flight  time  groups  with  a direction  of  seriousness  assigned 
are  shown  in  Table  XVIII. 
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TABLE  XVIII 


Ten  Most  Discriminating  Errors  for  Flight  Hour 
Group  Classification  and  Direction 

DISCRIMINANT  ERROR  DIRECTION  OF  SERIOUSNESS 


E SERIOUS 

MED 

EXCEED  DESIGN  AIRSPEED  FOR  FLAP 

SETTING 

LOW 

HIG 

RAISING  GEAR  BEFORE  BRAKES  COOL 

BLOWING  THERMAL  PLUGS 

HIG 

MED 

LOW 

FLARE  TOO  HIGH 

HIG 

LOW 

MED 

IMPROPER  USE  OF  DEICING  EQUIPMENT 

HIG 

LOW 

MED 

MAKE  A WHEELS  UP  PASS 

HIG 

MED 

LOW 

NOT  INVESTIGATING  CAUSE  OF  "ANTI  ICE" 
LIGHT  ILLUMINATION 

MED 

HIG 

LOW 

GO  IFR  ON  A VFR  CLEARANCE 

MED 

LOW 

HIG 

MAKE  A HARD  LANDING  "G"  METER  EXCEEDS 

5. 2G' s 

MED 

LOW 

HIG 

TAKE  OFF  WITH  FLAPS  NOT  SET  AT  "T.O. 

AND  APPROACH" 

MED 

LOW 

HIG 

INDUCE  AN  AUTO  FEATHER  BY  RAPID  P/L 
MOVEMENT 

LOW 

MED 

HIG 

Nine  of  the  ten  errors  listed  above  are 

from  the 

Accep- 

table  and  Runway  Environment  Technique 

Clusters  described  in 

the  previous  chapters.  Interestingly, 

it  is 

not  the 

most 

serious  errors  that  discriminate,  but  generally  the  less 
serious,  innocuous,  acceptable  errors  that  best  portray  the 
discrimination.  This  phenomenon  may  support  the  "pilot" 
versus  "aviator"  concept  described  in  Chapter  V,  in  that 
attitudes  towards  Acceptable  Errors  (errors  that  "pilot"-type 
flyers  are  likely  to  make)  and  attitudes  towards  Runway 
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Environment  Technique  Errors  (errors  that  "aviator " -type  fly- 
ers are  likely  to  make)  are  attitudes  that  change  most  as 
a pilot  gains  in  experience. 

Table  XIX  shows  the  aggregate  seriousness  ranking  by 
103  pilots  for  all  sixty  errors.  Listed  to  the  right  is 
the  position  of  each  error  as  ranked  by  each  flight  hour 
group.  It  is  apparent  from  this  table  that  all  three  groups 
agree  that  FAIL  TO  MAINTAIN  SAFE  FLYING  SPEED,  ENTER  UNCON- 
TROLLED FLIGHT  is  the  most  serious  error  and  SHIFT  HAND  TO 
NOSEWHEEL  STEERING  TOO  SOON  is  the  least  serious  error. 

The  errors  between  all  vary  in  seriousness,  with  some  varying 
to  a small  degree  and  some  to  a larger  degree. 

The  study  of  these  changes  in  seriousness  obviously 
requires  further  research.  Ultimately,  however,  they  may 
give  us  clues  as  to  how  to  structure  our  safety  programs, 
training  sequencing,  or  even  primary  flight  training  error 
emphasis.  What  is  needed  is  to  link  pilots'  attitudes  toward 
the  seriousness  of  errors  with  some  real-world  indicator  of 
the  actual  seriousness  in  some  desired  criterion  such  as 
dollars  or  lives  lost.  Then  some  form  of  sequenced  error 
emphasis  in  training  or  safety  programs  could  be  presented 
to  attempt  to  close  the  gap  between  the  seriousness  applied 
to  errors  by  pilots  and  the  real  seriousness  of  errors  in 
terms  of  cost.  A check  on  the  changes  in  attitudes  toward 
seriousness  might  be  in  the  form  of  card  sorting  much 
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CHAPTER  VII 


ATTRIBUTES 

As  briefly  described  IV,  the  second  fleet  pilot 

study  group  of  52  pilots,  in  addition  to  the  sorting  and 
seriousness  rank  g,  were  asked  i rank  order  thirteen 
errors  in  terms  of  [lowing  four  attributes:  CAREER, 

RATTLE,  EMBARRASSMENT  md  FUN.  The  thirteen  errors  were 
chosen  because  the',  fel  cl-  • ro  the  three  axes  of  the 
mult  id imens  ion.-  all  sixty  errors  for  the  first 

fleet  pilot  group,  near  the  or  midpoints  of  those  axes. 

Errors  were  also  that  were  distributed  throughout 

the  three  major  clusterings.  It  is  believed  that  although 
the  thirtee  .mall,  manageable  number  of  errors,  they 

also  represent  the  sntire  action  space  of  the  total  sixty 
errors . 

Each  pilot  was  asked  to  accomplish  each  of  the  following 
using  the  same  card  deck  of  thirteen  selected  errors: 

Rank  order  chest  rrors  from  "most"  to  "least" 
as  you  perceive  they  would  ruin  your  career  if 
they  we  to  happen  to  you.  (Titled  CAREER) 

Rank  order  tc  rrors  from  "most"  to  "least" 

as  you  porce  ,ey  would  rattle  you  or  break 

y nr  conce  it  ; if  they  were  to  happen  to 

you.  (Titled  RATTLE) 

Rank  order  >rs  from  "most"  to  "least" 

is  vc  ..o:.  t hey  would  embarrass  you  if 

on  was  notified. 

(Titled  EMBARRASSMENT) 
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Although  making  these  errors  would  be  no  real 
fun,  strange  as  it  may  seem,  there  is  some 
positive  affect  from  making  errors.  For  the 
sake  of  research,  rank  order  these  errors 
from  "most"  to  "least"  as  you  perceive  they 
are  fun.  (Titled  FUN) 

A word  should  be  said  here  about  the  attribute  of  fun. 
In  the  "Eight  Ball  Study”  and  other  sports  related  studies, 
Roberts,  et  al . , found  that  certain  behaviors  had  positive 
affect  for  the  players  even  though  the  behaviors  were  in 
fact,  mistakes  or  examples  of  poor  play.  An  example  from 
the  "Eight  Ball  Study,"  is  MAKING  A BLAST  SHOT.  This  be- 
havior in  the  game  of  "Eight  Ball"  was  an  example  of  poor 
play  but  for  many  players,  fun  to  perform.  Many  pilots, 
including  the  author,  found  it  difficult  to  think  about 
error  making  as  fun,  but,  with  some  explanation  the  pilots 
were  able  to  rank  order  the  thirteen  errors  on  this  attrib- 
ute. For  example,  some  pilots  did  agree  that  a certain 
positive  affect  was  associated  with  salvaging  a landing 
from  a poor  approach. 

The  thirteen  errors  shown  in  Table  XX  are  listed  in 
order  of  adverse  impact,  as  perceived  by  the  52  pilots. 

This  rank  order,  based  upon  mean  position  runs  from  most 
adverse  effect  (TAXI  OFF  THE  TAXIWAY  AT  NIGHT)  to  least 
adverse  effect  (FAILURE  TO  NOTE  VOR  OFF  FLAG). 
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TABLE  XX 


CAREER  RANK  ORDER 


CAREER 

RATTLE 

EMBARRASS 

FUN 

TAXI  OFF  THE  TAXI WAY  AT  NIGHT 

1 

4 

2 

12 

MAKE  A WHEELS  UP  PASS 

2 

1 

1 

11 

ABORT  T.O.  BEYOND  REFUSAL, 

3 

3 

1 

4 

9 

SMOKE  REMOVAL  DOOR  POPS  OPEN 
CALL  FOR  WRONG  ENGINE  TO  BE 

4 

2 

6 

10 

FEATHERED 

CREWMAN  INJURED  DURING  HEAVY 

5 

7 

7 

13 

WEATHER  FLYING 

TAKE  OFF  WITH  PITOT  COVERS 

6 

5 

3 

7 

LEFT  ON 

DECLARE  A LOW  FUEL  STATE  DUE 

7 

8 

8 

8 

TO  HEADWINDS 

UNABLE  TO  RAISE  GEAR  DUE  TO 

8 

10 

5 

2 

GEAR  PINS  BEING  LEF'I  IN 

INDUCE  AN  AUTO  FEATHER  BY 

9 

6 

9 

4 

RAPID  P/L  MOVEMENT 

GO  IFR  ON  A VFR  CLEARANCE 

10 

11 

12 

3 

SALVAGE  A LANDING  FROM  A 

11 

9 

10 

1 

POOR  APPROACH . . - 
EXCEED  DESIGN  AIRSPEED  "OR 

12 

12 

11 

5 

FLAP  SETTING 

FAILURE  TO  NOTE  VOR  OFF  FLAG 

13 

13 

13 

6 

The  career  attribute  was  chosen  foi  the  written  listing 


in  Table  XX  since  it  ssents,  in  the  author's  view,  the 


pilot's  perception  of  how  "the  system"  (the  Navy  as  an  organi- 
sation) looks  the  error  action  space.  Stated  in  another 
way,  TAXI  OFF  THE  TAXIWAY  AT  NIGHT  and  MAKE  A WHEELS  UP  PASS 
are  not  as  likely  to  be  tolerated  by  cognisant  Navy  officials 
as  EXCEED  DESIGN  AIRSPEED  DR  FLAP  SETTING  and  FAILURE  TO 
NOTE  VOR  OFF  FLAG.  In  1 XX,  then,  we  have  a rank  ordering 
of  errors  that  approximates  the  real  world  acceptance  of  these 
errors  by  Nava  thorities — at  least  as  the  pilots  themselves 
perceive  that  acceptance.  to  tl  i right  on  Table  XX 
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are  the  averages  of  rank  order  standings  for  each  of  the 
other  three  attributes.  It  is  apparent  that  the  attributes 
of  RATTLE  and  EMBARRASSMENT  show  much  the  same  rank  ordering 
pattern  as  the  CAREER  attribute,  and  as  might  be  expected 
the  attribute  of  FUN  is  ranked  in  roughly  an  inverse  order 
when  compared  to  the  other  three  attributes. 

An  examination  of  this  table  poses  some  interesting 
questions.  For  example,  the  error  perceived  to  be  the 
number  one  career  wrecker,  TAXI  OFF  THE  TAXIWAY  AT  NIGHT, 
as  compared  with  the  third  from  the  least  (11th  in  rank 
order)  perceived  career  wrecker,  SALVAGE  A LANDING  FROM  A 
POOR  APPROACH  THAT  SHOULD  HAVE  BEEN  A WAVEOFF,  tells  US 
several  interesting  things.  If  a pilot  runs  his  aircraft 
off  the  taxiway  at  night,  he  feels  it  will  affect  his  career, 
it  will  rattle  him  somewhat,  it  will  embarrass  him,  and  it 
will  not,  relatively  speaking,  be  fun.  On  the  other  hand, 
to  continue  on  to  a landing  from  an  approach  that  was  so 
poorly  executed  that  the  approach  should  have  been  abandoned 
will  not,  in  the  pilot's  perception,  seriously  affect  his 
career,  nor  rattle  or  embarrass  him,  but  he  does  perceive  it 
as  fun,  in  fact  it  is  number  one  in  the  fun  ranking.  Para- 
doxically, however,  common  sense  tells  us  that  taxiing  off 
the  taxiway  at  night  is  not  the  type  of  error  that  will 
ordinarily  result  in  extensive  damage  to  the  aircraft  and 
loss  of  life.  Available  evidence  indicates  clearly  that  the 
approach  and  landing  phase  are  the  most  critical  portions 
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of  the  flight,  and  approach  and  landing  accidents  are  much 
more  likely  to  cause  fatalities  and  aircraft  damage  than 
taxiing  off  the  taxiway  at  night.  Simple  comparison  of 
average  aircraft  speeds  for  example,  when  each  error 
occurs  tells  the  story,  5-10  knots  taxiing  and  120-140 
knots  during  the  approach  and  landing.  The  same  argument 
can  be  applied  to  GO  TFR  ON  A VFR  CLEARANCE  and  EXCEED 
DESIGN  A/S  FOR  FLAP  SETTING.  Both  errors  are  perceived 
as  not  likely  to  rattle,  embarrass,  nor  affect  one's  career, 
but  are,  in  a way,  fun.  The  risk  of  mid-air  collision  or 
collision  with  tin  ground  is  always  present  when  a pilot 
goes  I FR  on  a VFR  clearance,  and  the  risk  of  structural 
failure  of  flaps  and  resulting  uncontrolled  flight  is  a 
real  possibility  and  present  when  exceeding  design  airspeed 
limitations  for  the  flap  setting.  Both  have  the  potential 
to  result  in  much  greater  damage  than  taxiing  the  aircraft 
off  the  taxiway. 

The  task  then  is  to  change  pilots'  perceptions  of  the 
"system"  and  their  attitudes,  in  order  to  make  it  more  career 
damaging,  more  embarrassing  and  less  fun  to  commit  the  errors 
that  are  likely  to  lead  to  loss  of  lives  and  aircraft  damage. 

: r e the  goal  is  not  to  make  pilots  less  conscious  of 

r,  but  instead  to  make  him  more  aware  of  the 
f thf  iii vage-a-1 anding  error.  One  answer 
that  will  allow  post  flight 
-*  • , v higher  authority,  leading 


to  discovery  of  errors  of  the  salvage-a-landing  type. 

In  other  words,  it  may  be  advisable  to  change  attitudes 
toward  errors  to  bring  these  attitudes  more  in  line  with 
the  real  costs,  in  the  broadest  sense,  of  each  error. 

Because  of  the  exploratory  nature  of  this  study,  a 
number  of  other  promising  attributes  were  left  for  study 
in  the  future.  These  include  real  importance,  admiration, 
shame,  blame  and  luck.  Obviously  this  ground  is  fertile 
for  future  research. 


CHAPTER  VIII 

CONCLUSION,  NEW  DIRECTIONS 

This  analysis  of  some  of  the  factors  involved  in  error 
structuring  and  attitudes  toward  errors  may  be  likened  to 
sculpting  the  Venus  de  Hilo  with  a blunt  sledge  hammer.  The 
author  is  neither  a trained  behavioral  scientist,  anthropol- 
ogist nor  a safety  expert.  Moreover,  knowledge  of  mental 
organization  itself  is  still  in  the  discovery  stage.  Prac- 
tical recommendations  cannot  be  made  without  further,  more 
refined  study,  but  we  believe  that  the  novel  approach  pre- 
sented here  tells  a great  deal  about  the  real  world  of  pilot 
errors  and  suggests  a wide  range  of  promising  avenues  for 
further  research. 

What  have  we  learned?  We  have  learned  (although  cer- 
tainly not  conclusively)  that  it  is  possible  to  use  hierarchical 
clustering  techniques  to  make  explicit  certain  implicit  pat- 
terning of  pilot  errors  that  existed  in  the  P-3  pilot  popula- 
tion when  the  survey  was  taken.  Our  evidence  demonstrates, 
we  believe,  that  pilots  have  sort  of  cognitive  map  of  the 
error  space  into  which  they  fit  things  which  go  wrong.  They 
have  error  clusters  that  give  dimension,  shape  and  structure 
to  the  error  domain.  A further  study  of  this  domain  may  show 
cultural  differences  and  live  us  indicators  of  the  optimum 
or  safest  structuring  and  hov.  to  tailor  our  training  and 
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safety  programs  to  achieve  that  optimum  structuring.  This 
whole  concept  can  be  applied  to  any  other  aircraft,  pilots 
in  general,  submarines,  ships  or  any  vehicle  or  machine 
operated  by  man. 

This  study  also  suggests,  but  does  not  fully  demonstrate, 
that  multidimensional  scaling  can  identify  significant  dimen- 
sions of  the  error  space  for  the  P-3  pilot  population.  This 
underlying  constellation  of  errors  that  has  interpretable 
dimensions  tells  us  how  pilots  view  errors,  gives  us  clues 
as  to  how  to  impart  knowledge  about  these  errors  and  gives 
us  directions  for  the  further  study  of  errors. 

The  use  of  scaling  and  discriminant  analysis  in  the 
study  of  pilots'  perception  of  the  seriousness  of  errors  has 
shown  us  a variation  in  a certain  percentage  of  errors  be- 
tween groups  of  pilots  with  varying  amounts  of  flight  hours, 
as  well  as  differences  which  appear  to  be  associated  with 
factors  unique  to  the  two  locations.  These  differences  in 
attitudes  must  be  examined  more  closely,  b.i<  we  believe  that 
they  too  hold  significant  implications  for  the  structure  of 
training  and  safety  programs. 

The  scaling  of  pilots  attitudes  toward  the  attributes 
of  FUN,  CAREER,  RATTLE  and  EMBARRASSMENT  suggests  rather 
convincingly  that  it  is  possible  to  use  a selected  subset  of 
errors  to  model  the  larger  domain,  and  that  pilots'  attitudes 
expressed  toward  errors  may  not  coincide  with  what  is  optimum 
from  a safety  viewpoint  or  what  is  desired  by  their  superiors. 
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The  basic  thrust  of  this  study  has  been  to  discover 
group  attitudes  and  perceptions  toward  errors  on  a broad 
cultural  plane.  The  next  step  must  be  taken  with  care  and 
cannot  be  taken  without  a great  deal  of  carefully  designed 
research.  That  step  is  to  bridge  the  gap  from  broad  cul- 
tural group  attitudes  to  individual  performance  and  behavior. 
The  ultimate  goal  of  this  research  would  be  eventually  to 
use  our  knowledge  of  error  space  structuring  in  such  a way 
that  given  groups'  or  individuals'  problems  could  be  diag- 
nosed and  corrected. 

In  all,  this  study  was  intended  to  examine  whether 
pilot  errors  are  culturally  patterned;  in  general  this 
patterning  does  seem  to  exist  and  to  match  the  realities 
of  the  situation.  However,  there  is  evidence  of  bias  and 
lack  of  reality  as  well.  It  is  this  area  of  bias  and  lack 
of  reality  that  requires  much  further  study  and  ultimately, 
perhaps,  correction  in  the  future. 
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NOTES 


Chapter  I 

1.  Clayton  Knight  and  K.S.  Knight,  Plane  Crash  - 
Mysteries  of  Major  Air  Disasters  and  How  They  Were  Solved 
(New  York:  Greenburg , 15)58)  , p"I  127 . 

2.  J.S.  Shuckburgh , "Accident  Statistics  and  the 
Human  Factor  Element,"  Aviation,  Space  and  Environmental 
Medicine , January  1975,  p.  76. 

3.  John  M.  Roberts  and  Gary  Chick,  "Butler  County 
Eight  Ball,  A Behavioral  Space  Analysis,"  In  press: 

Sports,  Games  and  Play:  Social  and  Psychological  Viewpoints 
Jeffrey  H.  Goldstein , Editor. 

4.  Roberts  deals  with  mapping  in  earlier  studies. 


Chapter  II 

1.  R.G.  D' Andrade,  "U-Statistics  Hierarchical  Clus- 
tering," In  press:  Psychometrika . 

2.  Several  highly  experienced  P-3  pilots  were  con- 
sulted when  the  opinion  of  an  informed  judge  was  required; 
some  were  utilized  as  subjects  for  pre-testing  before 
interviewing  Fleet  Pilots. 

3.  The  KYST  Program;  Kruskal,  Young  and  Seery,  1973, 
which  is  a factor  analysis-type  program  that  plots  relation- 
ships among  the  data,  giving  form  or  structure  to  the  informa- 
tion. In  a way  it  organizes  the  "space"  of  the  data  so  that 
observations  regarding  the  data  can  be  made. 
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